Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
EU
L3.3 70B Euryale v2.3
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Swift Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
Vision
HU
Hunyuan-MT-7B
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
GGUF
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
OM
Omega Arsenal 31B Final
Omega · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
LT
LTX Video 0.9.6 distilled
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
QW
Qwen2.5-14B-Instruct-1M
Qwen · Mungert
Params14.8B
Context986K
Q4_K_M9.2 GB
GGUF
LA
m51Lab MiniMax M2.7 REAP 139B A10B
Lab · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
GGUF
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
GGUF
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
LL
codellama_codellama-13b-instruct-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ON
OneJev 27B
Onejev · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
CA
causallm_7b
TheBloke
Params7.72B
Context8K
Q4_K_M4.8 GB
Tool useVision
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
WI
wizardlm_wizardcoder-python-34b-v1.0
Wizardcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
QW
Qwen Image 2.1 Turbo Quantized
Qwen · abenzerps
Params7.1B
Context—
Q4_K_M4.1 GB
GGUF
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Reasoning
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use

Other quants

Keep browsing