Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
DE
Husky v1 Math Deepseekmath 7b Instruct
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
chinese llama 2 7b
Llama · hfl
Params6.93B
Context4K
Smallest2.6 GB
MI
nbeerbower bophades mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
LL
llama 3 Korean Bllossom 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 32B AGI
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
NI
L3.1 Celestial Stone 2x8B
Niitama · QuantFactory
Params13.7B
Context128K
Q4_K_M8.3 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · AlekseiPravdin
Params7.81B
Context128K
Q4_K_M4.8 GB
RA
RakutenAI 7B chat
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
LL
Llama 3 8b 64k PoSE
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Unichat llama3 Chinese 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
fpham_writing_partner_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
JI
jina embeddings v2 base en
Jina · second-state
Params137M
Context8K
Q4_K_M0.1 GB
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 E2B It Qat
Gemma · prithivMLmods
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 4b It
Gemma · gaianet
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen Image Edit Rapid AIO
Qwen · Dsaf69
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
CH
ChaoticNeutrals Prima LelantaclesV5 7b
Chaoticneutrals · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
conceptofmind_llongma-2-7b
Llongma · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB