GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
ShieldLM 14B Qwen
Qwen · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
QW
HEFT Qwen
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
MI
MiroThinker v1.5 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
PH
UNCENSORED Phi 3 mini 4k geminified Q4 K M
Phi · v8karlo
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
KI
OpenYourMind Qwopus3.5 122B A10B Kimi K2.6 destill healed abliterated ROCMPFX
Kimi · rcmorano
Params122B
Context256K
Smallest67.5 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash 1017 GSQ RCO upstream
DeepSeek · HumanjavaEnterprises
Params748B
Context1024K
Smallest248.8 GB
ReasoningTool use
MA
mageflow
Mage · gguf-org
Params4.12B
Context—
Smallest0.3 GB
GGUF
QW
Deliberation Reflector Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
CH
Chocolatine 2 14B Instruct DPO v2.0b1 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
AP
Apriel 1.6 15b Thinker Magic_beta Decensored
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
KO
ko r1 14b v2.0.3 i1
mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
NextCoder 7B
Nextcoder · gabriellarson
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
ZE
Zephyr 7b Beta_Bio Tutor_Dpo
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spydaz_Web_AI
Spydazweb · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
SO
SocialR1 8B
Socialr · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
QW
UnifiedReward Think Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
AN
ankiGPT Small
Ankigpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GL
GLM 5.3 Flash REAP50 FP8 v2
GLM · mradermacher
Params165B
Context1024K
Smallest61.4 GB
ReasoningTool useVision
GL
GLM 4.7 Flash
GLM · DhruvalLabs
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
QU
quant type
Quant · gguf-org
Params—
Context—
Q4_K_M0.0 GB
GGUF
PH
TOI 157 Phi 4 Reasoning Mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
RYS Phi 3 Medium 4k Instruct
Phi · mradermacher
Params17.7B
Context4K
Q4_K_M10.8 GB
GGUF
ZE
zephyr dpo v2 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.1 8B abliterated
Llama · gulan28
Params8.03B
Context128K
Smallest8.5 GB
Tool use
ME
Med RwR
Med · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
QW
Qwen3 30B A3B NSFW JP
Qwen · mradermacher
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningTool use

Keep browsing