Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Jan-Nano
Jan · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GP
GPT OSS Cybersecurity 20B Merged
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
AN
Anime Girl 1.5B
Anime · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
GE
gemma 4 E2B it qat q4 0 heretic
Gemma · FadedRedStar
Params4.63B
Context128K
Smallest0.1 GB
CodingVision
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
GE
Gemma 4 E2B It Uncensored MAX
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Reasoning
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
GGUF
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
MA
Marco Mini Instruct
Marco · mradermacher
Params17.3B
Context32K
Q4_K_M10.5 GB
Reasoning
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DA
pocketdoc_dans-totsirocco-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
WA
wan 1.3b
Wan · bykhan
Params127M
Context—
Q4_K_M1.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · kingjones777
Params3.88B
Context256K
Q4_K_M2.8 GB
GGUF
QW
dolphin 2.9.2 qwen2 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingTool use
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
MI
MistralLite 7B
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
Reasoning

Other quants

Keep browsing