GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
CH
chatterbox
Chatterbox · calcuis
Params264M
Context—
Q4_K_M0.3 GB
LI
Ling 3.0 tiny
Ling · NANI-Nithin
Params7.89B
Context128K
Q4_K_M4.8 GB
WA
Wan2.2 VACE Fun A14B NSFW Merge
Wan · PineAmbassador
Params17.3B
Context—
Q4_K_M11.6 GB
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
MI
MiMo V2.6 Flash RL NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ggml-org
Params8.95B
Context256K
Smallest9.5 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ZE
huggingfaceh4_zephyr-7b-beta
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
PH
Phi 3.1 mini 128k instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GL
GLM 4.5 Air Derestricted
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
FA
Fara1.5 27B
Fara · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
BI
Biomni R0 32B Preview
Biomni · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · AtomicChat
Params115M
Context—
Smallest0.5 GB
MI
Ming Image GGUFs
Ming · realrebelai
Params6.15B
Context—
Q4_K_M5.9 GB
PY
Pyrut 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GL
GLM 5.3 Flash Uncensored
GLM · axi0mX
Params321B
Context1024K
Smallest93.3 GB
PH
Phi 4 Mini Instruct
Phi · lmstudio-community
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
MiMo V2.6 Distill Qwen 9B heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
MiMo-V2.6-Pro-RL
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
MI
MiMo V2.6 Flash MOPD
Mimo · QuantaPlanta
Params310B
Context1024K
Smallest174.9 GB
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Aggressive
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB