Q4_0 GGUF models
Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
flux2 klein 4B uncensored text encoder
Qwen · Cordux
Params4B
Context—
Smallest2.4 GB
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QV
QVikhr 3 4B Instruction
Qvikhr · Vikhrmodels
Params4B
Context40K
Q4_K_M2.5 GB
ED
EdgeRock 4B
Edgerock · hkust-aaron
Params4.58B
Context256K
Q4_K_M2.9 GB
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
CL
Clef Flash
Clef · taurusduan
Params9.1B
Context256K
Q4_K_M6.0 GB
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama 2 7B Guanaco QLoRA
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GO
GodziLLa 30B i1
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
OP
OpenCodeInterpreter-DS-1.3B
Opencodeinterpreter · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
OR
Ornith 1.5 397B
Ornith · bartowski
Params397B
Context256K
Q4_K_M241.8 GB
TR
Trinity Nano Preview
Trinity · arcee-ai
Params6.12B
Context128K
Q4_K_M3.8 GB
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
OR
Orca 2 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
RA
RakutenAI-7B-instruct
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.3 GB
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen Image 2.1 Uncensored
Qwen · daddysteven
Params7.12B
Context—
Q4_K_M4.6 GB
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
DO
Donnager 70B v1 i1
Donnager · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
YI
Faro Yi 34B DPO i1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB