Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 s base v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CL
clip-vit-large-patch14/
Clip · mys
Params428M
Context—
Smallest0.1 GB
LI
A.X-4.0-Light
Light · cookieshake
Params7.26B
Context16K
Q4_K_M4.4 GB
CO
Codefu 7b v0.1
Codefu · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
NightyGurps 14b v1.1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 4B
Qwen · ZuzeTt
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Math IIO 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
IM
Z Image
Image · vantagewithai
Params6.15B
Context—
Q4_K_M5.0 GB
QW
CursorCore QW2.5 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
calme-2.3-legalkit-8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
StockLLama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
OpenELM-3B-Instruct
Openelm · QuietImpostor
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
Cendol Llama2 13b Merged
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
CR
crackthejob codingLLM
Crackthejob · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
TI
TinyLlama-1.1B-step-50K-105b
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
BO
Boris 125M Instruct
Boris · opencerebral
Params124M
Context1K
Q4_K_M0.1 GB
LL
Na0s Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
Llama 3 8B 16K GGUF smashed
Llama · PrunaAI
Params8.03B
Context16K
Q4_K_M4.9 GB
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
LL
winglian llama 3 8b 256k PoSE
Llama · RichardErkhov
Params8.03B
Context512K
Q4_K_M4.9 GB
RE
web doc refining lm
Redpj · QuantFactory
Params354M
Context2K
Q4_K_M0.2 GB
LL
llama3.1 gutenberg 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SM
SmolLM 135M Instruct
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
BR
Breeze-7B-Base-v1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 Coder 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
RW
RWKV6 7B v3 Porn Chat Pro
Rwkv · mzwing
Params7.64B
Context1024K
Q4_K_M4.8 GB
GR
granite-8b-code-instruct-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB