Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
JA
Jais Adapted 7b Chat
Jais · QuantFactory
Params7B
Context4K
Q4_K_M4.3 GB
AL
Alpha Orionis v0.1
Alpha · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
MythoMax L2 13b
Mythomax · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
TU
Turkcell LLM 7b v1
Turkcell · QuantFactory
Params7.38B
Context32K
Q4_K_M4.5 GB
IN
Intel neural chat 7b v3 1
Intel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
KA
KAT Coder V2.5 Dev
Kat · RemySkye
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mika 7B
Mika · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
L3.1 Celestial Stone 2x8B
Niitama · QuantFactory
Params13.7B
Context128K
Q4_K_M8.3 GB
MI
MiniCPM5 1B
MiniCPM · RemySkye
Params1.08B
Context128K
Q4_K_M0.7 GB
CE
Celeste 12B V1.6
Celeste · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3 4B Thinking 2507 Heretic
Qwen · ZuzeTt
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
TI
TinySlime 1.1B Chat v1.0
Tinyslime · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
BI
Bielik 4.5B v3.0 Instruct
Bielik · second-state
Params4.76B
Context8K
Q4_K_M2.9 GB
IN
bronya-rand_inairtra-7b
Inairtra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Peach Instruct 4x8B MoE
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
ZI
Zion_Alpha
Zion · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
SK
SkyReels V3 14B
Skyreels · vantagewithai
Params18.9B
Context—
Q4_K_M10.1 GB
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB