Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen Image Edit
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
CO
CohereForAI aya 23 35B
Cohereforai · RichardErkhov
Params35B
Context—
Q4_K_M0.0 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
gemma-1.1-7b-it
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AI
Airoboros L2 70B 2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
JA
stabilityai_japanese-stablelm-instruct-gamma-7b
Japanese · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0 uncensored
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FU
Fun CosyVoice3 0.5B 2512
Fun · Lourdle
Params859M
Context—
Q4_K_M0.6 GB
GGUF
MO
Moonlight 16B A3B Instruct
Moonlight · mmnga
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
QW
Qwen2.5-VL-7B-Instruct
Qwen · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
WA
Wan2.2 Fun 5B InP
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
qwen image edit
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
SU
Sulphur 2 base
Sulphur · fairy322
Params21B
Context—
Q4_K_M14.3 GB
GGUF
YI
01-ai_yi-6b-200k
Yi · TheBloke
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
OX
OxCoder 9B
Oxcoder · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
YI
01 ai Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
WA
Wan2.1 T2V 14B FusionX VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
FA
90m Instruct
Falcon · tiiuae
Params91M
Context256K
Q4_K_M0.1 GB
GGUF

Other quants

Keep browsing