Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3-VL-4B-Instruct
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
MI
nbeerbower Gutensuppe mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
KA
Karakuri Lm 7b Apm v0.1
Karakuri · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
gemma 4 E4B it OBLITERATED
Gemma · Abiray
Params7.46B
Context128K
Q4_K_M5.3 GB
AL
all-MiniLM-L12-v2
All · leliuga
Params33M
Context512
Q4_K_M0.0 GB
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
FL
flux controlnet
Flux · licyk
Params11.9B
Context—
Smallest5.2 GB
HE
G9v3 3B Heretic Abliterated
Heretic · Vortecks
Params3B
Context128K
Q4_K_M1.8 GB
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DA
Loki v2.6 8b 1024k
Daybreak · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
UI
UIGEN T3.1 8B Full Demo No Reasoning
Uigen · gabriellarson
Params8.19B
Context40K
Q4_K_M5.0 GB
ST
L3 SthenoMaid 8B V1
Sthenomaidblackroot · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
OU
OuteTTS 1.0 0.6B
Outetts · OuteAI
Params602M
Context40K
Q4_K_M0.4 GB
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 0.5B Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
DE
deepseek-coder-1.3b-chat-and-function-calling
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
LT
ltx video 2b v0.9.1
Ltx · pollockjj
Params1.92B
Context—
Smallest0.7 GB
GE
gemma 3 1b it Abliterated
Gemma · anlord
Params1B
Context32K
Q4_K_M0.8 GB
ML
mlfoundations dev stackoverflow 5000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · LiteLLMs
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
Meta-Llama-3-8B-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · Dzluck
Params6.74B
Context16K
Q4_K_M4.1 GB
LA
Labradorite 13b
Labradorite · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB