GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Coder 3B Instruct
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
ddh0_orcamaid-v3-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
QW
Qwen1.5 55B Chat Cut i1
Qwen · mradermacher
Params54.8B
Context32K
Q4_K_M33.3 GB
FL
Flux2 Klein 9B True V2
Flux · BIGJUTT
Params9.08B
Context—
Smallest5.7 GB
AI
airoboros-70b-3.3
Airoboros · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
ST
stable-code-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
OP
openNemo 9B Claude Opus 4.6 Distill
Opennemo · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
MO
MotherEarth Storm 1.0 8B
Motherearth · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
Breeze TTS 2
Breeze · agentory
Params—
Context—
Smallest4.3 GB
GE
GEMMA SUTRA
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · Vastined
Params12.3B
Context1024K
Q4_K_M7.5 GB
MI
MiniMax M2.5 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · KM445
Params8.19B
Context40K
Smallest8.7 GB
VI
Visual LaylelemonMaidRP 7B i1
Visual · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
allura org Bigger Body 8b
Bigger · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
QW
Qwen3 Omni 30B A3B Thinking Heretic
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
LF
LFM3 Audio 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GL
Glm Edge V 2b
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
QW
Qwen3.8 Flash Next Prune11264 124B
Qwen · Atomic-Germ
Params124B
Context256K
Q4_K_M83.8 GB
CL
claude fable7 undecillion sse
Claude · oroboros-labs
Params14.8B
Context32K
Smallest9.0 GB
SA
Dr.Samantha-8B
Samantha · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CY
Cydonia 22B v1.1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
TO
Totvs Protheus ADVPL V0.1
Totvs · dyulianocecilio
Params9.2B
Context256K
Q4_K_M5.8 GB
MO
Moonshine Base (Vietnamese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
SO
Solar Open 69B REAP
Solar · mradermacher
Params69.4B
Context128K
Q4_K_M42.1 GB
JE
Jev Vision 0.8B
Jev · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB