GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
BI
bitvla libero
Bitvla · vrfai
Params1.03B
Context—
Smallest1.4 GB
GGUF
OR
ornith15 35b a3b apex mtp fixed
Ornith · conFIGur8tor
Params35.5B
Context256K
Smallest17.4 GB
GGUF
GL
GLM 4.7 Flash
GLM · Myric
Params31.2B
Context198K
Smallest10.2 GB
ReasoningTool use
PH
PhysX Omni
Physx · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
Vision
PH
phi 4 mini 3.8b instruct
Phi · lm-kit
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
QW
ReSearch Qwen 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
GGUF
PO
Power-WizardLM-2-13b
Power · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
KA
kappa 3 phi abliterated
Kappa · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi4
Phi · calcuis
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
SU
suna v1
Suna · jjcoders
Params190M
Context—
Q4_K_M0.4 GB
GGUF
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
GGUF
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · second-state
Params14B
Context128K
Q4_K_M8.6 GB
Coding
QW
Qwen3 8B RP v0.1
Qwen · Aratako
Params8.19B
Context40K
Q4_K_M5.0 GB
Roleplay
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
GGUF
SE
Seed Coder 8B Reasoning
Seed · mradermacher
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
RL
RLinf Math 7B
Rlinf · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
OP
OpenCarrot Mix 7B
Opencarrot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama Primus Merged
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing