Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
NO
nothingiisreal MN 12B Starcannon v2
Nothingiisreal · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
OL
Olmo 3 7B Instruct
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
GE
Gemma 4 Uncensored Aggressive
Gemma · tripolskypetr
Params4.65B
Context128K
Q4_K_M5.3 GB
PH
Borea Phi 3.5 Mini Instruct Common
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Llama2 12.8b_lora Dpo_V1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
SC
scottsuk0306 zephyr 7b math test
Scottsuk · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma-7b-it
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
ArliAI Llama 3 8B Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LI
lightblue reranker 0.5 cont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
UN
Unbabel TowerInstruct 7B v0.1
Unbabel · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama3 Med42 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 2B
Qwen · titan0115
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
chinese llama 2 7b 64k
Llama · hfl
Params6.93B
Context64K
Smallest2.6 GB
LL
YBXL Med LLaMA3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · RusteddDDD
Params7.5B
Context128K
Q4_K_M5.3 GB
LL
meta llama Llama 2 7b hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
JI
jieliu Storm 7B
Jieliu · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GI
Gille StrangeMerges 21 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Finance Chat
Finance · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
google shieldgemma 9b
Google · RichardErkhov
Params9.24B
Context8K
Q4_K_M3.1 GB
QW
Qwen3.5 27B Opus Reasoning v2 Abliterated EvoPress
Qwen · Flakily6416
Params26.9B
Context256K
Smallest10.7 GB
GR
Granite 3b Code Instruct 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy Gemmasutra 9B slerp
Gemma · AI-Art-Collab
Params9.24B
Context8K
Q4_K_M5.8 GB
FI
finance chat
Finance · andrijdavid
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
Magic-Dolphin-7b
Magic · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB