GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
chatterbox
Chatterbox · calcuis
Params264M
Context—
Q4_K_M0.3 GB
GGUF
LI
Ling 3.0 tiny
Ling · NANI-Nithin
Params7.89B
Context128K
Q4_K_M4.8 GB
Reasoning
WA
Wan2.2 VACE Fun A14B NSFW Merge
Wan · PineAmbassador
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
Vision
MI
MiMo V2.6 Flash RL NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
Coding
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
ReasoningTool useVision
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ggml-org
Params8.95B
Context256K
Smallest9.5 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
ZE
huggingfaceh4_zephyr-7b-beta
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
Vision
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GGUF
GL
GLM 4.5 Air Derestricted
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
GGUF
FA
Fara1.5 27B
Fara · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
Vision
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Vision
BI
Biomni R0 32B Preview
Biomni · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Coding
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · AtomicChat
Params115M
Context—
Smallest0.5 GB
GGUF
MI
Ming Image GGUFs
Ming · realrebelai
Params6.15B
Context—
Q4_K_M5.9 GB
GGUF
PY
Pyrut 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · axi0mX
Params321B
Context1024K
Smallest93.3 GB
Vision
PH
Phi 4 Mini Instruct
Phi · lmstudio-community
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
MI
MiMo-V2.6-Pro-RL
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
MI
MiMo V2.6 Flash MOPD
Mimo · QuantaPlanta
Params310B
Context1024K
Smallest174.9 GB
Vision
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Aggressive
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB
GGUF

Keep browsing