Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
GGUF
QW
Qwen2.5 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5 4B RpRMax v1
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
GE
Gemma 4 31B It Heretic
Gemma · NeuralDreamer
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingVision
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
GGUF
IC
IceEspressoRPv6 i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GP
gpt2 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
Coding
TH
Threnystril v2.0 7B slerp
Threnystril · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EL
Steelskull L3.3 Electra R1 70b
Electra · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GP
GPT4 X Alpasta 30b i1
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AS
astrollama 3 8b chat aic i1
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
Coding
SK
Skywork OR1 Math 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AS
astrollama 2 70b chat aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
PR
PreciseCoder 4B
Precisecoder · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Coding

Other quants

Keep browsing