All GGUF models
206,171 models with specs, quants and memory estimates.
Every GGUF model on this page shows the same facts: parameter count, trained context length, the size of each quant and an estimate of the memory it needs. Use the filters to narrow by family, size, quant, license or the VRAM you have, or open a model to compare its quants and run the check for your GPU. New to quant names? Read GGUF quantization explained.
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · ISTA-DASLab
Params177B
Context256K
Smallest66.4 GB
QW
Qwen3.8-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M16.5 GB
OR
Ornith-1.5-9B
Ornith · ornith-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
OR
Ornith-1.5-35B
Ornith · ornith-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8-27B iMatrix NVFP4 MTP
Qwen · cdiamond
Params461M
Context256K
Smallest17.1 GB
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
OR
Tiel Coder 35B A3B GGUF MTP
Ornith · peculiar-ragdoll
Params447M
Context256K
Smallest12.7 GB
QW
Qwen3.8 27B Uncensored
Qwen · JonathanColetti
Params27.3B
Context256K
Q4_K_M16.5 GB
OR
Ornith 1.0 9B
Ornith · ornith-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
QW
Qwen3.8-27B
Qwen · ggml-org
Params3B
Context256K
Q4_K_M19.0 GB
MX
mxbai-embed-large-v1
Mxbai · mixedbread-ai
Params334M
Context512
Smallest0.7 GB
QW
Ternary Bonsai 2 27B
Qwen · prism-ml
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3.8 27B
Qwen · byteshape
Params27.3B
Context256K
Smallest8.8 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
OR
Ornith 1.5 9B Uncensored
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen Image 2.1
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GE
Gemma-4-12B-It
Gemma · unsloth
Params11.9B
Context256K
Q4_K_M7.1 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
QW
Swift 1.5 Qwen3.8 27B GSQ RCO
Qwen · ukisai
Params27B
Context—
Smallest0.0 GB
OR
Ornith 1.0 35B
Ornith · ornith-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
LA
Laguna XS 2.1 APEX
Laguna · mudler
Params33.4B
Context256K
Smallest12.8 GB
QW
Qwen3.8-27B
Qwen · peculiar-ragdoll
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
QW
Qwen3.8 27B GSQ RCO
Qwen · ISTA-DASLab
Params27B
Context—
Smallest0.0 GB
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 35B A3B Distill
Qwen · empero-ai
Params35.5B
Context256K
Q4_K_M21.7 GB