All GGUF models
206,171 models with specs, quants and memory estimates.
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params177B
Context256K
Smallest67.2 GB
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
QW
Qwen3 Vl 8b Heretic 1.3.0
Qwen · DreamFast
Params8.19B
Context256K
Q4_K_M5.0 GB
GR
Groot 19B A3B 261023
Groot · bartowski
Params19B
Context256K
Q4_K_M12.5 GB
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Q3 K M
Qwen · Chungulus
Params27.3B
Context256K
Smallest13.5 GB
QW
Carnice Qwen3.6 MoE 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
OR
Ornith 1.5 35B A3B MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.5 27B Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CO
Confucius4 T3PO
Confucius · netease-youdao
Params14.8B
Context32K
Smallest10.5 GB
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PS
Psyonic Cetacean Ultra Quality 20b GGUF imat plus2
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
TI
Tini Cybersec 8B A1B
Tini · bartowski
Params8.47B
Context125K
Q4_K_M5.2 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
HO
K2-Horizon-7B
Horizon · bartowski
Params9B
Context512K
Q4_K_M5.8 GB
VE
Veloxy Titan 32B
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5-24B-A2B
Lfm · OS-Software
Params24B
Context128K
Q4_K_M14.5 GB
ST
StartLux Decision v1 27B BF16
Startlux · startlux-models
Params27B
Context256K
Smallest53.8 GB
SP
Spark X2.5 4B
Spark · ngquocvinh
Params4.1B
Context1024K
Q4_K_M2.6 GB
MI
Mistral 7B v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 35B A3B
Qwen · ggml-org
Params34.7B
Context256K
Smallest36.9 GB
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
KO
Kolibri 1
Kolibri · bartowski
Params78.1B
Context256K
Q4_K_M49.8 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB