GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
Aiaudio
Aiaudio · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LA
LAMAR 600m
Lamar · mradermacher
Params568M
Context8K
Q4_K_M0.4 GB
CodingEmbedding
GL
cerebras/GLM-4.7-REAP-268B-A32B
GLM · mradermacher
Params269B
Context198K
Q4_K_M162.3 GB
ReasoningTool use
QW
Qwen3 Coder 30B A3B Ilograph Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
TO
Toffee 3b Beta
Toffee · mradermacher
Params3.83B
Context8K
Q4_K_M2.4 GB
GGUF
PH
microsoft.Phi 4 Mini Reasoning
Phi · DevQuasar
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
AC
AceStep 5Hz LM 4B
Acestep · mradermacher
Params4.19B
Context40K
Q4_K_M2.6 GB
ReasoningTool use
QW
Es Qwen Math Base 7b 3k 40k Ds_O2 Stage1 Step2000
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
LO
LocoOperator 4B
Locooperator · SimplySara
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingTool use
LE
Lens GGUF ComfyUI
Lens · vantagewithai
Params4.1B
Context—
Q4_K_M2.5 GB
GGUF
AR
armaGPT i1
Armagpt · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
OR
Orsta 7B
Orsta · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
PH
phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
grounded ai phi3 toxicity judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
qwen 2 5 3b instruct using openai gsm8k gguf data enhanced with deepseek v3 small
Qwen · eagle0504
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
LL
GlotMAX 101 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
UnifiedReward 2.0 Qwen35 27b
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
UnifiedReward Edit Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
NE
Next2 Fast
Next · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
TI
Tinyllama 1.3B Cinder Reason Test 2
Tinyllama · Josephgflowers
Params1.28B
Context4K
Smallest1.4 GB
GGUF
MI
CAG Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ae Calem Mistral 7b v0.2
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AN
M3.1 24b Animus V4 Final
Animus · Darkhn-Quants
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
CH
Chatterbox Turbo
Chatterbox · Serveurperso
Params525M
Context8K
Q4_K_M0.3 GB
Vision
MI
Nexus IKM Mistral 7B MLX
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
VideoThinker R1 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
QW
Entropy Qwen3 8B Base DAPO14k
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
AT
Atlas Pro 7B Preview 1M
Athena · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use

Keep browsing