Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3.2 3B
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
OR
Ornith 1.5 9B
Ornith · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
LL
ELYZA japanese CodeLlama 7b instruct
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhrmodels · Vikhrmodels
Params8.04B
Context32K
Q4_K_M4.9 GB
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
CO
ajibawa-2023_code-33b
Code · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
BA
ehartford_based-30b
Based · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Rombos LLM V2.6 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
OR
Ornstein Hermes 3.6 27B SABER
Ornstein · gkraker04
Params26.9B
Context256K
Smallest9.4 GB
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
LLaMA2 13B Erebus v3
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3Guard Gen 0.6B
Qwen · QuantFactory
Params752M
Context32K
Q4_K_M0.5 GB
DO
L3 OVA Test 8B
Domain · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
TL
tlphams solar 10.7b merged v0.1
Tlphams · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
ArliAI Llama 3 8B Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Codestral-22B-v0.1
Mistral · SanctumAI
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.5 9B
Qwen · titan0115
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
ST
dolphincoder-starcoder2-15b
StarCoder · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
MA
MadKFC MergedCPsyModel
Madkfc · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OneLLM Doey V1 Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
SK
SkyReels V2 DF 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
FL
FLAMA 0.5 3B
Flama · xaviviro
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB