GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
IM
Z images models
Images · Andyhere
Params4.02B
Context40K
Smallest5.1 GB
ReasoningTool use
LL
LLaDA 1.5
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 Psychological Reasoning 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
GL
zai org GLM 4.6
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash
DeepSeek · mxxm-t
Params748B
Context1024K
Smallest8.0 GB
GGUF
VI
vibevoice
Vibevoice · gguf-org
Params2.7B
Context—
Q4_K_M3.5 GB
GGUF
GL
Huihui GLM 4.6V Flash Abliterated
GLM · seanbailey518
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
NU
NuExtract v1.5
Nuextract · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
NO
Nous Capybara 34B
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LO
LongCat Flash Lite Sparse Ultra Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
GGUF
PH
Phi 3 mini 4k geminified
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GR
Grug 9b
Grug · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
CodingReasoningTool use
TE
test gguf models
Test · ngxson
Params2B
Context32K
Q4_K_M1.2 GB
GGUF
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Emollm InternLM2.5 7B chat GGUF fp16
InternLM · Slipstream-Max
Params7.74B
Context32K
Smallest15.5 GB
GGUF
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
SN
Snowpiercer 15B v1
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
Coding
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
PY
Pyrz 8B Instruct Uncensored i1
Pyrz · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OR
Deepreinforce ai_Ornith 1.0 9B
Ornith · lmstudio-community
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
SD
sdcpp gguf dtype typeconf poc
Sdcpp · ybgwon96
Params—
Context—
Smallest0.0 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
PH
Phi 3 mini 4k instruct
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning

Keep browsing