GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
BI
bitvla libero
Bitvla · vrfai
Params1.03B
Context—
Smallest1.4 GB
OR
ornith15 35b a3b apex mtp fixed
Ornith · conFIGur8tor
Params35.5B
Context256K
Smallest17.4 GB
GL
GLM 4.7 Flash
GLM · Myric
Params31.2B
Context198K
Smallest10.2 GB
PH
PhysX Omni
Physx · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
PH
phi 4 mini 3.8b instruct
Phi · lm-kit
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
ReSearch Qwen 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
PO
Power-WizardLM-2-13b
Power · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
KA
kappa 3 phi abliterated
Kappa · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi4
Phi · calcuis
Params14.7B
Context16K
Q4_K_M8.9 GB
SU
suna v1
Suna · jjcoders
Params190M
Context—
Q4_K_M0.4 GB
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
PH
Phi 3 medium 128k instruct
Phi · second-state
Params14B
Context128K
Q4_K_M8.6 GB
QW
Qwen3 8B RP v0.1
Qwen · Aratako
Params8.19B
Context40K
Q4_K_M5.0 GB
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
SE
Seed Coder 8B Reasoning
Seed · mradermacher
Params8.25B
Context64K
Q4_K_M5.1 GB
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
RL
RLinf Math 7B
Rlinf · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
OpenCarrot Mix 7B
Opencarrot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama Primus Merged
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB