Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GU
Guanaco 7B Uncensored
Guanaco · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · crusoeai
Params14B
Context4K
Q4_K_M8.4 GB
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
Gemma 3 4b It
Gemma · DavidAU
Params3.88B
Context128K
Q4_K_M3.3 GB
LL
FinGPT MT Llama 3 8B LoRA
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
HU
hunyuan
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
JS
jsfs11 MixtureofMerges MoE 2x7bRP v8
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
CO
Chromadb Context 1
Context · ryancook
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
GE
Rumeni 1 Nano
Gemma · kirilldual0987
Params4.65B
Context128K
Q4_K_M3.4 GB
MY
MythoMakiseMerged 13B
Mythomakisemerged · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
HI
HiDream I1 Fast
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
TR
Trendyol LLM 7b base v0.1
Trendyol · tolgadev
Params6.84B
Context4K
Q4_K_M4.2 GB
CH
perlthoughts_chupacabra-7b-v2
Chupacabra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
qwen2.5 reinstruct alternate lumen 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
DE
Deepthink Reasoning 7B imatrix
Deepthink · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
SE
weyaxi_seraph-openchat-3.5-1210-slerp
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
granite 7b lab
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB