Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MP
mpt 7b
Mpt · QuantFactory
Params6.65B
Context2K
Q4_K_M4.3 GB
NI
L3.1 Storniitova 8B
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
OL
OLMo 7B Instruct Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
LL
grok oss Revenant 70B
Llama · c4tdr0ut
Params70.6B
Context128K
Q4_K_M42.5 GB
VI
vinallama-2.7b
Vinallama · RichardErkhov
Params2.77B
Context4K
Q4_K_M1.7 GB
KU
KURE v1
Kure · mykor
Params567M
Context8K
Q4_K_M0.4 GB
NU
NuExtract3
Nuextract · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
rinna llama 3 youko 8b
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
TA
Taiwan LLM 7B v2.0.1 chat
Taiwan · ZoneTwelve
Params6.74B
Context4K
Q4_K_M4.1 GB
UN
UNA-TheBeagle-7b-v1
Una · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
cosmo 1b
Cosmo · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
GE
AriannaV4_merged
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
OP
openchat v3.2 super
Openchat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
OpenCaption 4B VL SFT v1.0
Opencaption · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
LL
Meta-Llama-3-8B-Instruct
Llama · SanctumAI
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
Trendyol LLM 8b Chat v2.0
Trendyol · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
ChatAYT Lora Assamble Marcoroni
Chatayt · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Josiefied Qwen2.5 1.5B Instruct Abliterated v1
Qwen · Goekdeniz-Guelmez
Params1.5B
Context32K
Q4_K_M1.1 GB
GE
Atlas Chat 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llm Jp 3 980m Instruct3
Llm · mmnga
Params990M
Context4K
Q4_K_M0.6 GB
SO
sanjiwatsuki_sonya-7b
Sonya · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
DO
Dolphin3 Cyber 8B
Dolphin · V12nm
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
gemma-7b-it
Gemma · second-state
Params8.54B
Context8K
Q4_K_M5.1 GB
MM
mmq test
Mmq · Beinsezii
Params14.8B
Context128K
Smallest0.4 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB