GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.2 MaxMin108
GLM · turintech
Params325B
Context1024K
Smallest102.8 GB
ReasoningTool use
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
FL
flux dev de distill
Flux · BigStationW
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
DO
Doctor-R1
Doctor · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
JO
JOSIE 2 2B OSS
Josie · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CH
ChatMusician
Chatmusician · MaziyarPanahi
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SN
Snowpiercer 15B v2
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
MI
MiMo V2.5 Pro
Mimo · bartowski
Params1020B
Context1024K
Q4_K_M622.9 GB
CodingReasoningTool use
BG
bge reranker base Q4 K M
BGE · sabafallah
Params278M
Context512
Q4_K_M0.2 GB
Embedding
QW
UnifiedReward Edit Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
KY
Kyro n1 7B i1
Kyro · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
OR
Ornith 1.5 9B Heretic
Ornith · teddy19032
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
PA
MS3.2 PaintedFantasy Visage v4 34B
Paintedfantasy · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
Roleplay
KY
Kyro n1 14B Chat i1
Kyro · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
LI
Ling 3.1 flash Uncensored
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ReasoningTool use
GE
Survival Uncensored Gemma 270m v2
Gemma · pixasocial
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
FA
Fara1.5 4B
Fara · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GL
GLM-4.5V
GLM · ggml-org
Params107B
Context64K
Q4_K_M63.6 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
KI
Kimi VL A3B Thinking 2506
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
ReasoningVision
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
BL
Q3.5 BlueStar v2 27B
Bluestar · zerofata
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
LA
Lawma 8b
Lawma · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Gemma 2 9b It SimPO
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
OP
OPRM 72B
Oprm · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
Llama Phi 3 DoRA
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
MI
MiMo NeoHorse 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use

Keep browsing