GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
KA
Kandinsky 6.0 Pro 5s GGUFs
Kandinsky · realrebelai
Params—
Context—
Smallest20.4 GB
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
AC
scragvae
Ace · scragnog
Params169M
Context—
Smallest0.3 GB
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
OR
Ornith 1.5 122B Uncensored
Ornith · AtomicChat
Params125B
Context256K
Smallest54.3 GB
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
CH
chatterbox
Chatterbox · cstr
Params264M
Context—
Smallest0.0 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
LI
Lingshu 32B
Lingshu · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
MI
MiMo Negentropy 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Gmcoder Bf16
Qwen · emperorofrome
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Tiel Coder 35B A3B APEX I NanoPlus
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
PE
Peach 2.0 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mimo-V2.5-Pro
Mimo · unsloth
Params1020B
Context1024K
Q4_K_M629.6 GB
LO
LongCat Video Avatar ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.0 GB
NO
nousresearch_nous-capybara-7b-v1.9
Nous · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith-1.5-9B
Ornith · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
PH
Phi 4 Reasoning Plus
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
DE
DeepSeek V4 Flash 0731 REAP 150b TQ3 4S
DeepSeek · Tinker-Stack
Params150B
Context—
Smallest0.2 GB
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
LL
Nous Hermes Llama2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Q4_K_M5.0 GB
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB