Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LT
LTX 2
Ltx · unsloth
Params18.9B
Context—
Q4_K_M12.8 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · thesven
Params7B
Context32K
Q4_K_M4.4 GB
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
WA
Wan2.1 T2V 14B
Wan · city96
Params14.3B
Context—
Q4_K_M10.1 GB
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
FB
fblgit juanako 7b UNA
Fblgit · RichardErkhov
Params7.24B
Context—
Q4_K_M0.0 GB
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
LFM2.5 2.6B GGUF shards
Lfm · Arki05
Params2.7B
Context128K
Smallest0.0 GB
CY
z image cyberrealistic v9
Cyberrealistic · gimly13
Params6.15B
Context40K
Q4_K_M2.5 GB
TI
py007_tinyllama-1.1b-chat-v0.3
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
WA
wan 1.3b
Wan · calcuis
Params127M
Context—
Q4_K_M1.0 GB
QW
Qwen2.5-VL-3B-Instruct
Qwen · Mungert
Params3.1B
Context125K
Q4_K_M1.9 GB
QW
Qwen2.5 Coder 0.5B Instruct AWQ
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
HO
K2 Horizon 7B
Horizon · IFM
Params9B
Context512K
Q4_K_M5.6 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · desirel
Params16.4B
Context—
Q4_K_M10.8 GB
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
QwQ 32B
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
SA
Sao10K L3 8B Stheno v3.1
Sao · RichardErkhov
Params8B
Context—
Q4_K_M0.3 GB
QW
Qwen Image Edit Rapid AIO
Qwen · Phil2Sat
Params7.62B
Context125K
Q4_K_M4.7 GB
WA
Wan2.2 VACE Fun A14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
BG
bge reranker v2 m3
BGE · gpustack
Params568M
Context8K
Q4_K_M0.4 GB
WA
Wan2.1 I2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen Image Layered
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
LO
LongCat Video Avatar 1.5 GGUF ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.1 GB
QW
SpaceTimee/Suri-Qwen-3.8-27B-Uncensored
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
MI
avemio digital mistral 7b Sft pretrain 6000 steps merge
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M0.1 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
MY
MythoMax L2 13B
Mythomax · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB