Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
CodeLlama 7B KStack clean
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral 7B Instruct v0.2 GGUF smashed
Mistral · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
UM
Umievo Itr012 Gleipnir 7B
Umievo · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
JA
japanese-novel-gpt-j-6b
Japanese · mmnga
Params6.05B
Context2K
Q4_K_M3.7 GB
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
ST
StableBeluga 7B
Stablebeluga · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GR
Granite 3.3 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
GL
LongWriter Glm4 9b
GLM · QuantFactory
Params9.4B
Context1024K
Q4_K_M6.3 GB
GE
gemma-4-12B-it
Gemma · Mungert
Params11.9B
Context256K
Q4_K_M7.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Gemma 2 9b It
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama2 7B Hindi finetuned
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3.3-8B-Instruct
Llama · Mungert
Params8B
Context8K
Q4_K_M5.3 GB
QW
Qwen3 TTS 12Hz 0.6B
Qwen · BricksDisplay
Params661M
Context32K
Q4_K_M0.4 GB
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
YI
Yi 1.5 6B Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Kant-Test-0.1-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
pythia 160m
Pythia · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
ST
Starling LM 7B Beta
Starling · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LT
ltxv 13b 0.9.7 distilled
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB