GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
FractalAIResearch.Fathom R1 14B RS
Fathom · csabakecskemeti
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GL
GLM Z1 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
ZY
Zyphra.ZR1 1.5B
DevQuasar-13
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
GP
Gpt Oss 20b Base
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
GP
gpt-neox-japanese-1.4b
Gpt · mmnga
Params1.41B
Context1K
Q4_K_M0.9 GB
GGUF
ST
Stable DiffCoder 8B Instruct
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
Coding
DE
DeepSeek R1 Distill Llama 8B BE
DeepSeek · taronaeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
PAPO D Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
MiMo V2.6 Distill Qwen 9B ROCmFP4
Qwen · kingjones777
Params8.95B
Context256K
Smallest4.8 GB
ReasoningTool useVision
VI
VisualQuality R1 7B
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool useVision
GL
GLM 5.3 Flash GM CoT
GLM · cgg507
Params321B
Context1024K
Smallest138.9 GB
GGUF
GL
Glm-4.7-Flash
GLM · andrewheins55
Params29.9B
Context198K
Q4_K_M18.3 GB
ReasoningTool use
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
AF
After Earth Director 8B
After · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
MiMo 7B RL 0530 Qwenified
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Training Dna V1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
UnifiedReward Edit Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
DE
DeepSeek V4 Flash Base
DeepSeek · ReingeFallen
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
AU
audioseal
Audioseal · cstr
Params23M
Context—
Smallest0.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · codegood
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
UL
UltraLink LM
Ultralink · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
GE
JiRackTernaryGemma4 26b
Gemma · CMSManhattan
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingTool use
GI
GigaChat3 702B A36B Preview
Gigachat · bartowski
Params702B
Context128K
Q4_K_M427.2 GB
Tool use
CO
Configurable-Janus-7B
Configurable · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
Kartik Kundli AI 3B v2.0
Kartik · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
MistralPrism 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GL
Huihui ai.GLM 4 32B 0414 Abliterated
GLM · DevQuasar-13
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
FO
Foxtool 8B
Foxtool · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
CodingReasoningTool use
BL
Q3.5 BlueStar 27B Ultra Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use

Keep browsing