Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
RW
Rwkv7 G1 1.5b Lonely Neko
Rwkv · mzwing
Params1.53B
Context1024K
Q4_K_M1.0 GB
GE
DiscoPOP zephyr 7b gemma
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Llama Phishsense 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
NO
nothingiisreal L3 8B Instruct Abliterated DWP
Nothingiisreal · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 72B
Qwen · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
MU
HY-MT1.5-1.8B
Mungert · Mungert
Params1.79B
Context256K
Q4_K_M1.2 GB
LL
laislemke LLaMA 2 vicuna 7b slerp
Llama · RichardErkhov
Params6.74B
Context32K
Q4_K_M0.6 GB
LL
Evolved Llama3 ELYZA Uncensored 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
BO
boto 7B
Boto · lucianosb
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
pygmalion-1.3b
Pygmalion · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GP
gpt-oss-20b-Derestricted
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
QW
Nanonets-OCR2-3B
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M2.0 GB
ST
stable diffusion 3 medium
Stable · city96
Params2.08B
Context—
Q4_K_M1.3 GB
YU
yuntian deng gpt2 explicit cot multiplication 20 digits
Yuntian · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
LL
BRAG Llama 3.1 8b v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DataPilot Llama3.1 ArrowSE v0.4
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
DataPilot ArrowPro 7B KUJIRA
Datapilot · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
Llama3 8B Aifeifei 1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OpenMath-CodeLlama-13b-Python-hf
Llama · Mungert
Params13B
Context16K
Q4_K_M7.8 GB
SA
Saul 7B Base
Saul · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AH
Ahma 3B Instruct
Ahma · RichardErkhov
Params3.63B
Context2K
Q4_K_M2.8 GB
LL
Llama 3 Taiwan 8B Instruct DPO
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SakanaAI EvoLLM JP A v1 7B
Sakanaai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
hooking dev sexyGPT Uncensored
Hooking · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
LL
Llama 3.2 1B Instruct
Llama · SanctumAI
Params1.24B
Context128K
Q4_K_M0.8 GB
CA
cais Zephyr RMU
Cais · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Small Llama3 6B
Llama · ukung
Params6.29B
Context8K
Q4_K_M3.9 GB
SE
SenseNova U1.5 8B MoT
Sensenova · NANI-Nithin
Params17.5B
Context—
Smallest10.9 GB
MI
jointpreferences mistral 7b sft helpful
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB