Q4_0 GGUF models
Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
YU
Yue2-3B-GGUF
Yue · tungnguyen84
Params677M
Context—
Smallest0.3 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · prithivMLmods
Params7.52B
Context64K
Q4_K_M5.3 GB
TI
py007_tinyllama-1.1b-intermediate-step-480k-1t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic v2
Gemma · OS-Software
Params25.2B
Context256K
Smallest14.2 GB
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
OX
OxCoder 9B
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
AU
Aurelian v0.5 70b Rope8 32K Fp16
Aurelian · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
JA
Jais Adapted 70b Chat
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
LA
latxa-70b-v1.2
Latxa · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
CH
MN CharThink 12B Base
Charthink · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3.8 Flash Next MTP
Qwen · quimmedes
Params3.88B
Context256K
Smallest1.2 GB
FU
FuseChat-Kunoichi-10.7B
Fusechat · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
TH
TheSpice 7b FT ExperimentalOrca
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
DA
pocketdoc_dans-adventurouswinds-mk2-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenChat 3.5 7B Mixtral v2.0 i1
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
nurtureai_openhermes-2.5-mistral-7b-16k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
AR
arco reasoner i1
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB