GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Phi 4 Deepseek R1K RL EZO
DeepSeek · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · kigimues
Params197B
Context—
Smallest110.6 GB
GGUF
GE
gemma 2 2b persian i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DE
DeepSeek V4 Flash 0731 RANMA EXL3
DeepSeek · SaturnHeaven
Params285B
Context1024K
Smallest110.0 GB
GGUF
US
UserLM 8b
Userlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BA
BAHAMUTH PURGED 3.2 1B i1
Bahamuth · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingReasoningRoleplay
DE
RM R1 DeepSeek Distilled Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
GL
GLM 5.3 Flash
GLM · mussonking
Params321B
Context1024K
Smallest105.4 GB
ReasoningTool use
MI
ming image
Ming · gguf-org
Params6.15B
Context—
Smallest0.3 GB
GGUF
LL
Llama 2 70b hf ChatOrca v2 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
EL
Electricity Meter OCR 7B
Electricity · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
IN
InfiGFusion 14B
Infigfusion · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
LL
RYS Llama 3.1 8B Instruct
Llama · mradermacher
Params8.68B
Context128K
Q4_K_M5.3 GB
Tool use
EV
EviOmni Nq_Train 7B
Eviomni · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek V4 Flash
DeepSeek · sleepyeldrazi
Params155B
Context1024K
Smallest50.4 GB
ReasoningTool use
SP
SpydazWeb AI ImageText Text Project i1
Spydazweb · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
GP
Gpt2 Xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Midm 2.0 Mini Thinking
Midm · mradermacher
Params2.54B
Context32K
Q4_K_M1.6 GB
ReasoningTool use
AT
Atomight 2 1.5B Thinking
Atomight · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
GP
OpenAI Gpt Oss 20B GPT5.1 5.2 DISTILL Heretic Uncensored MXFP4
gpt-oss · squ0sh
Params20B
Context128K
Smallest12.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated GSQ RCO IQ1 M Q6Engram
DeepSeek · ZHUOZA
Params748B
Context1024K
Smallest282.0 GB
ReasoningTool useVision
QW
UnifiedReward Edit Qwen35 4b
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
ZE
Zephyr 7B Beta
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GI
GigaChat3.5 432B A28B Reasoning
Gigachat · ai-sage
Params438B
Context256K
Q4_K_M262.2 GB
ReasoningTool use
QW
DAT Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
QW
Qwen3 VL 8B Vision GRPO HealthCare
Qwen · rizkysulaeman
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
SV
SVILA 1 4B
Svila · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
VI
ViorikaLM 3B
Viorikalm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
DE
Derestricted Iceblink
Derestricted · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
ReasoningTool use

Keep browsing