Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool use
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Q4_K_M5.5 GB
GGUF
MO
L3 4X8B MOE Dark Planet Infinite 25B
Moe · DavidAU
Params24.9B
Context8K
Q4_K_M15.2 GB
Roleplay
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
CodingReasoningTool use
SW
Swallow-70b-NVE-instruct-hf
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TO
tokyotech llm Swallow 7b NVE instruct hf
Tokyotech · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
Coding
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
ReasoningTool use
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
GGUF
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Q4_K_M4.9 GB
Vision
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
GGUF

Other quants

Keep browsing