Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
jondurbin_airoboros-m-7b-3.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UM
Umievo-itr012-Gleipnir-7B
Umievo · mmnga
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
QW
Qwen Image Edit 2511
Qwen · vantagewithai
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
MY
MythoLogic Mini 7B
Mythologic · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BR
Breeze-7B-Instruct-v0_1
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
AI
Airoboros L2 70B 3.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NO
argilla_notus-7b-v1
Notus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3 Next 80B A3B Thinking
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SW
Swallow 13b Instruct v0.1
Swallow · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
KU
sanjiwatsuki_kunoichi-7b
Kunoichi · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MY
Mythalion 13B
Mythalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 70B 2.1 Creative
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
GU
Guanaco 13B Uncensored
Guanaco · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openchat_openchat_3.5
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
WA
Wan2.1 I2V 14B FusionX
Wan · QuantStack
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
OL
OLMoE 1B 7B 0125 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
MI
jphme_em_german_leo_mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
asclepius-13b
Asclepius · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
openchat_openchat-3.5-0106
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
Nethena 13B
Nethena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
MI
paixai_astrid-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing