GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GL
GLM 5.2 MaxMin108
GLM · turintech
Params325B
Context1024K
Smallest102.8 GB
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
FL
flux dev de distill
Flux · BigStationW
Params11.9B
Context—
Q4_K_M6.9 GB
DO
Doctor-R1
Doctor · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
JO
JOSIE 2 2B OSS
Josie · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
CH
ChatMusician
Chatmusician · MaziyarPanahi
Params6.74B
Context2K
Q4_K_M4.1 GB
SN
Snowpiercer 15B v2
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
MI
MiMo V2.5 Pro
Mimo · bartowski
Params1020B
Context1024K
Q4_K_M622.9 GB
BG
bge reranker base Q4 K M
BGE · sabafallah
Params278M
Context512
Q4_K_M0.2 GB
QW
UnifiedReward Edit Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
KY
Kyro n1 7B i1
Kyro · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OR
Ornith 1.5 9B Heretic
Ornith · teddy19032
Params8.95B
Context256K
Q4_K_M5.6 GB
PA
MS3.2 PaintedFantasy Visage v4 34B
Paintedfantasy · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
KY
Kyro n1 14B Chat i1
Kyro · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LI
Ling 3.1 flash Uncensored
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
GE
Survival Uncensored Gemma 270m v2
Gemma · pixasocial
Params268M
Context32K
Q4_K_M0.3 GB
FA
Fara1.5 4B
Fara · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM-4.5V
GLM · ggml-org
Params107B
Context64K
Q4_K_M63.6 GB
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
KI
Kimi VL A3B Thinking 2506
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
BL
Q3.5 BlueStar v2 27B
Bluestar · zerofata
Params27B
Context256K
Q4_K_M16.5 GB
LA
Lawma 8b
Lawma · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 9b It SimPO
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
OP
OPRM 72B
Oprm · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Llama Phi 3 DoRA
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
MI
MiMo NeoHorse 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB