Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
SY
maywell_synatra-7b-v0.3-dpo
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
NA
Nanbeige 16B Base 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
SQ
defog_sqlcoder-34b-alpha
Sqlcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
JA
japanese-large-lm-1.7b
Japanese · mmnga
Params1.77B
Context2K
Q4_K_M1.2 GB
LL
Llama-3-Open-Ko-8B
Llama · teddylee777
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
ST
storytime 13B
Storytime · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
Yi Coder 9B
Coder · QuantFactory
Params8.8B
Context128K
Q4_K_M5.3 GB
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
WA
Wan2.1 Fun 14B InP
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
QW
Qwen2 Boundless
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
EC
Echidna 13B v0.3
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
VI
neko-institute-of-science_vicunlocked-30b-lora
Vicunlocked · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
SI
sanjiwatsuki_silicon-maid-7b
Silicon · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
palmyra mini thinking AIO
Palmyra · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.0 GB
LL
Chinese Llama 2 7B
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GE
Gemma 4 E4B It
Gemma · giladgd
Params7.5B
Context128K
Q4_K_M5.4 GB