GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
Vision
KA
Kandinsky 6.0 Pro 5s GGUFs
Kandinsky · realrebelai
Params—
Context—
Smallest20.4 GB
GGUF
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
AC
scragvae
Ace · scragnog
Params169M
Context—
Smallest0.3 GB
GGUF
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
OR
Ornith 1.5 122B Uncensored
Ornith · AtomicChat
Params125B
Context256K
Smallest54.3 GB
ReasoningTool useVision
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
ReasoningTool use
CH
chatterbox
Chatterbox · cstr
Params264M
Context—
Smallest0.0 GB
GGUF
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
LI
Lingshu 32B
Lingshu · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
ReasoningVision
MI
MiMo Negentropy 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Gmcoder Bf16
Qwen · emperorofrome
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
OR
Tiel Coder 35B A3B APEX I NanoPlus
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
CodingReasoningTool use
PE
Peach 2.0 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
Roleplay
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
MI
Mimo-V2.5-Pro
Mimo · unsloth
Params1020B
Context1024K
Q4_K_M629.6 GB
Coding
LO
LongCat Video Avatar ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.0 GB
GGUF
NO
nousresearch_nous-capybara-7b-v1.9
Nous · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith-1.5-9B
Ornith · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
DE
DeepSeek V4 Flash 0731 REAP 150b TQ3 4S
DeepSeek · Tinker-Stack
Params150B
Context—
Smallest0.2 GB
GGUF
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
Vision
LL
Nous Hermes Llama2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Q4_K_M5.0 GB
Reasoning
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB
Coding

Keep browsing