Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
UCLA AGI Mistral7B PairRM SPPO Iter3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
bhenrym14_airoboros-l2-13b-2.1-yarn-64k
Airoboros · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Tool useVision
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
LL
Llama 3.2 3B MoE 4Expert
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
Coding
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · saidutta69
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Roleplay
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
CO
beowolx_codeninja-1.0-openchat-7b
Codeninja · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
MiRL Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
PH
Athene Phi 3.5 mini instruct orpo
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
WI
wizardlm_wizardcoder-33b-v1.1
Wizardcoder · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
LL
Aion RP Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplay
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
GGUF
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Llama 2 7b Chat Hf Gpt 4 80k Base_Lora
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing