Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-VL-4B-Instruct
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
Tool useVision
MI
nbeerbower Gutensuppe mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
KA
Karakuri Lm 7b Apm v0.1
Karakuri · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
gemma 4 E4B it OBLITERATED
Gemma · Abiray
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
AL
all-MiniLM-L12-v2
All · leliuga
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
GGUF
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
FL
flux controlnet
Flux · licyk
Params11.9B
Context—
Smallest5.2 GB
GGUF
HE
G9v3 3B Heretic Abliterated
Heretic · Vortecks
Params3B
Context128K
Q4_K_M1.8 GB
Tool use
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DA
Loki v2.6 8b 1024k
Daybreak · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
UI
UIGEN T3.1 8B Full Demo No Reasoning
Uigen · gabriellarson
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
ST
L3 SthenoMaid 8B V1
Sthenomaidblackroot · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
OU
OuteTTS 1.0 0.6B
Outetts · OuteAI
Params602M
Context40K
Q4_K_M0.4 GB
GGUF
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2.5 0.5B Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
DE
deepseek-coder-1.3b-chat-and-function-calling
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
CodingTool use
LT
ltx video 2b v0.9.1
Ltx · pollockjj
Params1.92B
Context—
Smallest0.7 GB
GGUF
GE
gemma 3 1b it Abliterated
Gemma · anlord
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
ML
mlfoundations dev stackoverflow 5000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · LiteLLMs
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · Dzluck
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LA
Labradorite 13b
Labradorite · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other quants

Keep browsing