Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MO
moody wild mix v2
Moody · Gthalmie1
Params6.15B
Context—
Q4_K_M5.0 GB
LL
meta llama Llama 2 7b hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
14B Qwen2.5 Freya x1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
SU
SuperNova Medius
Supernova · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3-30B-A6B-16-Extreme
Qwen · Mungert
Params30.5B
Context40K
Q4_K_M18.9 GB
JI
jieliu Storm 7B
Jieliu · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GE
gemma-3-12b-it-codeforces-SFT
Gemma · BasedAGI
Params11.8B
Context128K
Q4_K_M7.3 GB
GI
Gille StrangeMerges 21 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Finance Chat
Finance · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
OU
OuteTTS 0.3 500M
Outetts · OuteAI
Params499M
Context32K
Q4_K_M0.4 GB
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
SE
SeaLLM 7B v2
Seallm · QuantFactory
Params7.38B
Context32K
Q4_K_M4.5 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
google shieldgemma 9b
Google · RichardErkhov
Params9.24B
Context8K
Q4_K_M3.1 GB
LE
Lelemon Maid 7B
Lelemon · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
EU
Eurus 2 7B PRIME
Eurus · brittlewis12
Params7.62B
Context4K
Q4_K_M4.7 GB
NE
Newton Bot 3 VLM Mini 4B
Newton · kirilldual0987
Params4.33B
Context256K
Q4_K_M2.8 GB
SM
SmolLM2 Prompt Enhance
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GE
SauerkrautLM Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GR
Granite 3b Code Instruct 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
LL
Llama-xLAM-2-8b-fc-r
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GE
Capybara 31B GGUFS
Gemma · TendieLabs
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy Gemmasutra 9B slerp
Gemma · AI-Art-Collab
Params9.24B
Context8K
Q4_K_M5.8 GB
FI
finance chat
Finance · andrijdavid
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
Magic-Dolphin-7b
Magic · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
unsloth ltx 2 3
Ltx · Nitram84
Params21B
Context—
Q4_K_M14.2 GB
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB