GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
FA
FractalAIResearch.Fathom R1 14B RS
Fathom · csabakecskemeti
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM Z1 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
ZY
Zyphra.ZR1 1.5B
DevQuasar-13
Params1.78B
Context128K
Q4_K_M1.1 GB
GP
Gpt Oss 20b Base
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GP
gpt-neox-japanese-1.4b
Gpt · mmnga
Params1.41B
Context1K
Q4_K_M0.9 GB
ST
Stable DiffCoder 8B Instruct
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
DE
DeepSeek R1 Distill Llama 8B BE
DeepSeek · taronaeo
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
PAPO D Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
MiMo V2.6 Distill Qwen 9B ROCmFP4
Qwen · kingjones777
Params8.95B
Context256K
Smallest4.8 GB
VI
VisualQuality R1 7B
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GL
GLM 5.3 Flash GM CoT
GLM · cgg507
Params321B
Context1024K
Smallest138.9 GB
GL
Glm-4.7-Flash
GLM · andrewheins55
Params29.9B
Context198K
Q4_K_M18.3 GB
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
AF
After Earth Director 8B
After · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
MiMo 7B RL 0530 Qwenified
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Training Dna V1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
UnifiedReward Edit Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek V4 Flash Base
DeepSeek · ReingeFallen
Params284B
Context1024K
Q4_K_M171.8 GB
AU
audioseal
Audioseal · cstr
Params23M
Context—
Smallest0.1 GB
PH
Phi 3.5 Mini Instruct
Phi · codegood
Params3.82B
Context128K
Q4_K_M2.4 GB
UL
UltraLink LM
Ultralink · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GE
JiRackTernaryGemma4 26b
Gemma · CMSManhattan
Params25.2B
Context256K
Q4_K_M16.8 GB
GI
GigaChat3 702B A36B Preview
Gigachat · bartowski
Params702B
Context128K
Q4_K_M427.2 GB
CO
Configurable-Janus-7B
Configurable · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
Kartik Kundli AI 3B v2.0
Kartik · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
MistralPrism 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GL
Huihui ai.GLM 4 32B 0414 Abliterated
GLM · DevQuasar-13
Params32.6B
Context32K
Q4_K_M19.7 GB
FO
Foxtool 8B
Foxtool · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
BL
Q3.5 BlueStar 27B Ultra Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB