Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
h2oai h2ogpt 16k codellama 13b instruct
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M1.7 GB
ST
starcoder2-15b
StarCoder · RichardErkhov
Params16B
Context16K
Q4_K_M9.9 GB
LF
Claude
Lfm · FlameF0X
Params1.17B
Context125K
Q4_K_M0.7 GB
RW
RWKV 5.2 3B NSFW Role 16k
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · LiteLLMs
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Arabic-Orpo-Llama-3-8B-Instruct
Llama · MohamedRashad
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 4B
Qwen · AaryanK
Params4.21B
Context256K
Q4_K_M2.7 GB
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
JS
jsfs11 MixtureofMerges MoE 2x7b v7
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
LL
OpenMath2 Llama3.1 8B
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
LL
Llama3 Med42 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QR
Qra 7b Dolly Instruction 0.1
Qra · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
LL
Turkish Llama 8b DPO v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
VE
MN 12B Vespa x1
Vespa · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
WI
WizardLM-13B-Uncensored
Wizardlm · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
SE
SecurityLLM
Securityllm · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Dolphin-2.9.1-Phi-3-Kensho-4.5B
Phi · crusoeai
Params6.54B
Context4K
Q4_K_M4.0 GB
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
chinese text correction 7b
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
CH
ChronoEdit 14B
Chronoedit · QuantStack
Params16.4B
Context—
Q4_K_M10.8 GB
GR
Granite 3.2 2b Instruct
Granite · ibm-research
Params2.53B
Context128K
Q4_K_M1.5 GB