Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3 0.6B
Qwen · second-state
Params752M
Context40K
Q4_K_M0.5 GB
UL
UltraMerge 7B
Ultramerge · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 8B Chinese Chat GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Ultragemma4 E2B Heretic Uncensored
Gemma · prithivMLmods
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 Ataraxy Doppel 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama3 ChatQA 1.5 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
SE
Seed Coder 8B Instruct
Seed · gaianet
Params8.25B
Context32K
Q4_K_M5.1 GB
DA
Dans AdventurousWinds 7b
Dans · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ET
steelskull_etheria-55b-v0.1
Etheria · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
ST
statking zephyr 7b sft full orpo
Statking · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
1 800 SHARED TASKS PHI3 Medium NLI 16bit
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
ML
MLewd ReMM L2 Chat 20B
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
YI
Dolphin 2.2 Yi 34B
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
QW
Replete LLM V2.5 Qwen 7b
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistral 7B Merge 14 v0.1
Mistral · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
OU
Oumuamua 7b instruct v2
Oumuamua · QuantFactory
Params7.33B
Context32K
Q4_K_M4.4 GB
SU
Sungur 14B GGUF
Sungur · suayptalha
Params14.8B
Context40K
Q4_K_M9.0 GB
BI
BioMistral DARE NS
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
Bielik 11B v2
Bielik · QuantFactory
Params11.2B
Context32K
Q4_K_M6.7 GB
WE
WestLake-7B-v2
Westlake · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
DM
dmis lab meerkat 7b v1.0
Dmis · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
TR
Translategemma 12b It
Translategemma · tatsuyaaaaaaa
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
ddh0_orcamaid-v3-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
AI
airoboros l2 13B 3.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · mmnga
Params23.6B
Context128K
Q4_K_M14.3 GB