Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
XY
Xyntetik Kvist 14B
Xyntetik · Joakimpalm-Zen
Params14.4B
Context128K
Smallest0.0 GB
GGUF
CO
CorticalStack neurotic crown clown 7b ties
Corticalstack · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · prithivMLmods
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
TI
py007_tinyllama-1.1b-intermediate-step-480k-1t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
Coding
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
Jais-3-3.7B
Jais · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
ReasoningTool use
JA
Jais Adapted 70b Chat
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
GGUF
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DA
pocketdoc_dans-adventurouswinds-mk2-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nurtureai_openhermes-2.5-mistral-7b-16k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
CodingTool use
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
GGUF
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b WikiChat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MI
ehartford_samantha-1.2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
sciphi_sensei-7b-v1
Sensei · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
teknium_collectivecognition-v1.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TU
Tulpar 7B v0
Tulpar · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3-8B-abliterated
Qwen · Mungert
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
FA
Fara 7B
Fara · gguf-org
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YO
You can cry Snowman 13B
You · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
ignos_leoscorpius-greennode-platypus-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing