Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
UIGEN FX 4B Preview
Qwen · QuantFactory
Params4.4B
Context256K
Q4_K_M2.7 GB
CO
Yi Coder 1.5B Chat
Coder · second-state
Params1.48B
Context128K
Q4_K_M1.0 GB
CO
C4Ai Command R7B Arabic 02 2025
Command R · matrixportalx
Params8.03B
Context16K
Q4_K_M5.1 GB
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
CH
Chinese Alpaca 2 7B
Chinese · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
ZE
qblocks_zephyr_7b_norobots
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
NA
Nanbeige 16B Chat 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
MI
MiniChat 1.5 3B
Minichat · tsunemoto
Params3.02B
Context4K
Q4_K_M1.8 GB
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
QW
QwQ 32B
Qwen · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
Trendyol LLM 7b chat dpo v1.0
Trendyol · tolgadev
Params7.34B
Context32K
Q4_K_M4.4 GB