Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
TI
TinyLlama-1.1B-intermediate-step-240k-503b
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
OneSQL v0.1 Qwen 32B
Qwen · onekq-ai
Params32.8B
Context32K
Q4_K_M19.9 GB
BU
BugTraceAI Apex G4 26B Master
Bugtraceai · piotreknow02
Params25.2B
Context256K
Q4_K_M16.8 GB
RU
RuishiCh0314 code mix model finetuned
Ruishich · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GE
Gemma 2 Ifable 9B
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 VL 4B Thinking Heretic
Qwen · ZuzeTt
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · brittlewis12
Params8.19B
Context128K
Q4_K_M5.0 GB
ST
starcoder2-7b
StarCoder · RichardErkhov
Params7.17B
Context16K
Q4_K_M4.5 GB
KU
Kunoichi-DPO-7B
Kunoichi · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.6
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo collective cognition
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · RichardErkhov
Params16B
Context16K
Q4_K_M9.9 GB
ML
mlfoundations dev oh v1.3 camel chemistry x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 medium 128k instruct
Phi · thesven
Params14B
Context128K
Q4_K_M8.6 GB
LL
Bllossom70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
PH
_phogpt
Phogpt · nguyenviet
Params3.75B
Context8K
Q4_K_M2.4 GB
LL
DeepHermes 3 Llama 3 8B Preview imatrix
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
SE
Seed Coder 8B Instruct
Seed · duyntnet
Params8.25B
Context32K
Q4_K_M5.1 GB
SM
SmolLlama-1.5B
Smolllama · RichardErkhov
Params1.54B
Context2K
Q4_K_M0.9 GB
MI
Mistral 7B Instruct V0.2_Bio Tutor_Dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
smol_llama-220M-GQA-fineweb_edu
Llama · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
QW
Qwen3-4B-Instruct-2507
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
MY
Myrrh_solar_10.7b_3.0
Myrrh · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.1 Korean 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
NO
NorLlama 3B
Norllama · RichardErkhov
Params3.07B
Context2K
Q4_K_M3.0 GB
LL
formapproval llama 8b WEbLINX ft WebLINX v2 vllm
Llama · RichardErkhov
Params2.7B
Context4K
Q4_K_M1.6 GB
TI
TildeOpen-30b
Tildeopen · Mungert
Params30.7B
Context64K
Q4_K_M19.0 GB
CO
codegemma 7b GGUF smashed
Codegemma · PrunaAI
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
mlfoundations dev hp ablations llama3 epoch2 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB