Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
SM
SmolVLM-256M-Instruct
SmolLM · Mungert
Params163M
Context8K
Q4_K_M0.1 GB
QW
MiroThinker-v1.0-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
NO
nothingiisreal MN 12B Starcannon v2
Nothingiisreal · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
MN 12B Chronos Gold Celeste v1
Chronos · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 ELYZA JP 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ET
EtherealAurora 12B
Etherealaurora · BasedAGI
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
Borea Phi 3.5 Mini Instruct Common
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Llama2 12.8b_lora Dpo_V1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
SC
scottsuk0306 zephyr 7b math test
Scottsuk · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GE
gemma-7b-it
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
ArliAI Llama 3 8B Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
SO
Solar Open 100B
Solar · AaryanK
Params103B
Context128K
Q4_K_M62.3 GB
LI
lightblue reranker 0.5 cont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
UN
Unbabel TowerInstruct 7B v0.1
Unbabel · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Tulu 3.1 8B SuperNova
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MP
mpt-7b-storywriter
Mpt · duyntnet
Params6.65B
Context64K
Q4_K_M4.3 GB
LL
Llama3 Med42 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma-7b-it
Gemma · mlabonne
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
Qwen3.5 2B
Qwen · titan0115
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
YBXL Med LLaMA3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
LL
Asclepius-Llama2-13B
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
CyberCore Qwen 2.1 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
MU
Muslim 6B PRO
Muslim · NightPrince
Params5.94B
Context256K
Q4_K_M3.7 GB
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB