Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
BI
Bielik 7B Instruct v0.1
Bielik · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
MA
Marx 3B v3
Marx · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
ehartford_samantha-mistral-instruct-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen2.5 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · thesven
Params8B
Context8K
Q4_K_M4.9 GB
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8B
Context8K
Q4_K_M5.1 GB
AY
Aya Expanse 32b Ungated
Aya · RichardErkhov
Params32.3B
Context8K
Q4_K_M19.8 GB
LL
llama polyglot 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
BL
bloom 560m
Bloom · QuantFactory
Params816M
Context1K
Q4_K_M0.6 GB
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
MI
starmpcc Asclepius Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
codellama CodeLlama 13b Python hf
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · Vikhrmodels
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
EU
Eurus 7b kto
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
VE
Vecteus v1
Vecteus · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB