GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
AI
Aiaudio
Aiaudio · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
LA
LAMAR 600m
Lamar · mradermacher
Params568M
Context8K
Q4_K_M0.4 GB
GL
cerebras/GLM-4.7-REAP-268B-A32B
GLM · mradermacher
Params269B
Context198K
Q4_K_M162.3 GB
QW
Qwen3 Coder 30B A3B Ilograph Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
TO
Toffee 3b Beta
Toffee · mradermacher
Params3.83B
Context8K
Q4_K_M2.4 GB
PH
microsoft.Phi 4 Mini Reasoning
Phi · DevQuasar
Params3.84B
Context128K
Q4_K_M2.5 GB
AC
AceStep 5Hz LM 4B
Acestep · mradermacher
Params4.19B
Context40K
Q4_K_M2.6 GB
QW
Es Qwen Math Base 7b 3k 40k Ds_O2 Stage1 Step2000
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
LO
LocoOperator 4B
Locooperator · SimplySara
Params4.02B
Context256K
Q4_K_M2.5 GB
LE
Lens GGUF ComfyUI
Lens · vantagewithai
Params4.1B
Context—
Q4_K_M2.5 GB
AR
armaGPT i1
Armagpt · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
OR
Orsta 7B
Orsta · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
grounded ai phi3 toxicity judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
qwen 2 5 3b instruct using openai gsm8k gguf data enhanced with deepseek v3 small
Qwen · eagle0504
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
GlotMAX 101 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
UnifiedReward 2.0 Qwen35 27b
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
UnifiedReward Edit Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
Next2 Fast
Next · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
TI
Tinyllama 1.3B Cinder Reason Test 2
Tinyllama · Josephgflowers
Params1.28B
Context4K
Smallest1.4 GB
MI
CAG Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ae Calem Mistral 7b v0.2
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AN
M3.1 24b Animus V4 Final
Animus · Darkhn-Quants
Params23.6B
Context128K
Q4_K_M14.3 GB
CH
Chatterbox Turbo
Chatterbox · Serveurperso
Params525M
Context8K
Q4_K_M0.3 GB
MI
Nexus IKM Mistral 7B MLX
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
VideoThinker R1 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Entropy Qwen3 8B Base DAPO14k
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
AT
Atlas Pro 7B Preview 1M
Athena · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB