All GGUF models

206,171 models with specs, quants and memory estimates.

Every GGUF model on this page shows the same facts: parameter count, trained context length, the size of each quant and an estimate of the memory it needs. Use the filters to narrow by family, size, quant, license or the VRAM you have, or open a model to compare its quants and run the check for your GPU. New to quant names? Read GGUF quantization explained.

QW
Qwen3.8 Flash Next GSQ RCO
Qwen · ISTA-DASLab
Params177B
Context256K
Smallest66.4 GB
Vision
QW
Qwen3.8-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
OR
Ornith-1.5-9B
Ornith · ornith-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
OR
Ornith-1.5-35B
Ornith · ornith-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3.8-27B iMatrix NVFP4 MTP
Qwen · cdiamond
Params461M
Context256K
Smallest17.1 GB
Vision
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
OR
Tiel Coder 35B A3B GGUF MTP
Ornith · peculiar-ragdoll
Params447M
Context256K
Smallest12.7 GB
CodingVision
QW
Qwen3.8 27B Uncensored
Qwen · JonathanColetti
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
OR
Ornith 1.0 9B
Ornith · ornith-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
QW
Qwen3.8-27B
Qwen · ggml-org
Params3B
Context256K
Q4_K_M19.0 GB
Vision
MX
mxbai-embed-large-v1
Mxbai · mixedbread-ai
Params334M
Context512
Smallest0.7 GB
Embedding
QW
Ternary Bonsai 2 27B
Qwen · prism-ml
Params27B
Context256K
Smallest5.9 GB
Vision
QW
Qwen3.8 27B
Qwen · byteshape
Params27.3B
Context256K
Smallest8.8 GB
Vision
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
OR
Ornith 1.5 9B Uncensored
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen Image 2.1
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
GE
Gemma-4-12B-It
Gemma · unsloth
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
QW
Swift 1.5 Qwen3.8 27B GSQ RCO
Qwen · ukisai
Params27B
Context—
Smallest0.0 GB
Reasoning
OR
Ornith 1.0 35B
Ornith · ornith-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
LA
Laguna XS 2.1 APEX
Laguna · mudler
Params33.4B
Context256K
Smallest12.8 GB
Coding
QW
Qwen3.8-27B
Qwen · peculiar-ragdoll
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
Vision
QW
Qwen3.8 27B GSQ RCO
Qwen · ISTA-DASLab
Params27B
Context—
Smallest0.0 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.8 35B A3B Distill
Qwen · empero-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningVision

Jump to a hub