Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama3-ChatQA-1.5-8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
aloobun_bun_mistral_7b_v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 14B sk
Qwen · worstplayer
Params14.8B
Context40K
Q4_K_M9.0 GB
RW
RWKV6 3B Chn UnlimitedRP Mini Chat HF
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GR
Granite 20b Code Instruct 8k
Granite · RichardErkhov
Params20.1B
Context8K
Q4_K_M12.8 GB
GE
gemma-2b
Gemma · leliuga
Params2.51B
Context8K
Q4_K_M1.6 GB
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 E4B It Qat
Gemma · prithivMLmods
Params7.46B
Context128K
Q4_K_M5.3 GB
NU
NuExtract 2.0 8B
Nuextract · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
HU
Huginn 22B Prototype
Huginn · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
NO
LemonadeRP 4.5.3
Noromaid · TheBigBlender
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
llama-3-chinese-8b-instruct-v3
Llama · hfl
Params8.03B
Context8K
Smallest3.2 GB
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
FA
Falcon 11B
Falcon · QuantFactory
Params11.1B
Context2K
Q4_K_M6.8 GB
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
Triangulum 1B
Triangulum · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
GE
saiga gemma2 10b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB