Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
UN
Uncensored Frank 13b
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · RichardErkhov
Params3.23B
Context128K
Q4_K_M2.0 GB
BA
jondurbin_bagel-dpo-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
mlabonne_neuralpipe-7b-ties
Neuralpipe · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3 0.6B Uncensored
Qwen · Null-Guard
Params596M
Context40K
Q4_K_M0.4 GB
OL
OLMo 2 1124 7B Instruct
OLMo · allenai
Params7.3B
Context4K
Q4_K_M4.5 GB
MA
Marcoroni 7b
Marcoroni · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite 8b Code Instruct 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · second-state
Params1.81B
Context8K
Q4_K_M1.1 GB
GE
Gemma 4 12B It Heretic_Decensored
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
cohere asr ja
Cohere · CKHO
Params2.07B
Context—
Smallest1.5 GB
RW
rwkv7 g1h 2.9b i1
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 14B_Uncencored_Instruct
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llm Jp 3 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
ZE
huggingfaceh4_zephyr-7b-alpha
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · simon5133
Params7.62B
Context128K
Q4_K_M9.4 GB
HE
calderaai_hexoteric-7b
Hexoteric · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB