GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
Phi 4 Deepseek R1K RL EZO
DeepSeek · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · kigimues
Params197B
Context—
Smallest110.6 GB
GE
gemma 2 2b persian i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
DE
DeepSeek V4 Flash 0731 RANMA EXL3
DeepSeek · SaturnHeaven
Params285B
Context1024K
Smallest110.0 GB
US
UserLM 8b
Userlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
BAHAMUTH PURGED 3.2 1B i1
Bahamuth · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
DE
RM R1 DeepSeek Distilled Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GL
GLM 5.3 Flash
GLM · mussonking
Params321B
Context1024K
Smallest105.4 GB
MI
ming image
Ming · gguf-org
Params6.15B
Context—
Smallest0.3 GB
LL
Llama 2 70b hf ChatOrca v2 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
EL
Electricity Meter OCR 7B
Electricity · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
IN
InfiGFusion 14B
Infigfusion · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
LL
RYS Llama 3.1 8B Instruct
Llama · mradermacher
Params8.68B
Context128K
Q4_K_M5.3 GB
EV
EviOmni Nq_Train 7B
Eviomni · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash
DeepSeek · sleepyeldrazi
Params155B
Context1024K
Smallest50.4 GB
SP
SpydazWeb AI ImageText Text Project i1
Spydazweb · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
Gpt2 Xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Midm 2.0 Mini Thinking
Midm · mradermacher
Params2.54B
Context32K
Q4_K_M1.6 GB
AT
Atomight 2 1.5B Thinking
Atomight · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GP
OpenAI Gpt Oss 20B GPT5.1 5.2 DISTILL Heretic Uncensored MXFP4
gpt-oss · squ0sh
Params20B
Context128K
Smallest12.1 GB
DE
DeepSeek V4.1 Flash 1017 abliterated GSQ RCO IQ1 M Q6Engram
DeepSeek · ZHUOZA
Params748B
Context1024K
Smallest282.0 GB
QW
UnifiedReward Edit Qwen35 4b
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ZE
Zephyr 7B Beta
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GI
GigaChat3.5 432B A28B Reasoning
Gigachat · ai-sage
Params438B
Context256K
Q4_K_M262.2 GB
QW
DAT Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3 VL 8B Vision GRPO HealthCare
Qwen · rizkysulaeman
Params8.19B
Context256K
Q4_K_M5.0 GB
SV
SVILA 1 4B
Svila · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
VI
ViorikaLM 3B
Viorikalm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
DE
Derestricted Iceblink
Derestricted · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB