All GGUF models
206,171 models with specs, quants and memory estimates.
CA
causallm_7b
TheBloke
Params7.72B
Context8K
Q4_K_M4.8 GB
TI
TIPO v2.1 1B A200M
Tipo · KBlueLeaf
Params1.01B
Context4K
Smallest1.1 GB
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
WI
wizardlm_wizardcoder-python-34b-v1.0
Wizardcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GL
GLM 5.3 Flash UNCENSORED mlx oQ8e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB
SE
SenseNova 6.8 Code2Video GSQ RCO
Sensenova · OliviaRossi
Params26.9B
Context256K
Smallest10.2 GB
SA
Sage A1.5 Sangreal ICE
Sage · gbuzhf
Params35.5B
Context256K
Smallest12.2 GB
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MA
Maple Preview
Maple · deepgrove
Params20.2B
Context128K
Smallest5.0 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8 27B EfficientThink VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8-27B
Qwen · jrell
Params27.3B
Context256K
Smallest13.5 GB
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB