All GGUF models
206,171 models with specs, quants and memory estimates.
OR
Ornith-1.5-397B
Ornith · ornith-ai
Params403B
Context256K
Q4_K_M244.3 GB
QW
Qwen3Vl 8b Instruct
Qwen · Qwen
Params8.19B
Context256K
Q4_K_M5.0 GB
WA
Wan2.1
Wan · DeepBeepMeep
Params9.2B
Context256K
Q4_K_M0.3 GB
GE
Gemma-4-26B-A4B-It
Gemma · unsloth
Params25.2B
Context256K
Q4_K_M16.9 GB
HY
HyperCLOVAX SEED Text Instruct 1.5B
Hyperclovax · rippertnt
Params1.81B
Context128K
Q4_K_M1.1 GB
QW
Qwen_Qwen3.8 27B
Qwen · lmstudio-community
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 Flash Next Uncensored
Qwen · orcarouter
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.8 Flash Next
Qwen · unsloth
Params177B
Context256K
Q4_K_M1.9 GB
GE
gemma 4 E4B it qat q4 0
Gemma · google
Params7.46B
Context128K
Smallest5.2 GB
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · ISTA-DASLab
Params260B
Context256K
Smallest58.4 GB
HY
Hy MT2 7B
tencent
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.0 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus3.8 27B Flash V2
Qwopus · Jackrong
Params28B
Context256K
Q4_K_M16.8 GB
QW
ThinkingCap Qwen3.8 27B
Qwen · bottlecapai
Params27.3B
Context256K
Q4_K_M17.4 GB
GE
gemma 4 12B it qat q4 0
Gemma · google
Params11.9B
Context256K
Smallest7.0 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params7.5B
Context128K
Q4_K_M5.3 GB
QW
Qwen2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
HU
Cyber Tiel Coder 35B A3B GGUF MTP
Huihui · peculiar-ragdoll
Params35.5B
Context256K
Q4_K_M22.5 GB
QW
Qwen3.8-27B
Qwen · agentionai
Params27.3B
Context256K
Q4_K_M16.5 GB
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM 5.3 Flash
GLM · unsloth
Params320B
Context1024K
Smallest93.1 GB
KA
KAT Coder V2.5 Dev APEX
Kat · mudler
Params34.7B
Context256K
Smallest13.5 GB
SP
Sharp Spark X2.5 4B
Spark · peculiar-ragdoll
Params4.11B
Context—
Smallest0.0 GB
OC
Occamy 1.0
Occamy · Accio-Lab
Params34.7B
Context256K
Q4_K_M21.2 GB
MU
Muse Glimmer 30B
Muse · unsloth
Params27.9B
Context128K
Smallest1.6 GB
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO
Qwen · ukisai
Params177B
Context—
Smallest0.6 GB
QW
Qwen3 8B Awq Compatible Instruct
Qwen · Qwen
Params8.19B
Context40K
Q4_K_M5.0 GB