Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
JO
JoyAI Image Edit Plus ComfyUI
Joyai · vantagewithai
Params16.3B
Context—
Q4_K_M11.6 GB
EU
euclaise ReMask 3B
Euclaise · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen Image 2512
Qwen · vantagewithai
Params20.4B
Context—
Q4_K_M13.0 GB
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma-4-E4B-it
Gemma · Mungert
Params7.52B
Context128K
Q4_K_M6.2 GB
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
ProjectZLLM SFT dna Llama 3.1 8B Instruct 20 r16 merged
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
LI
A.X-4.0-Light
Light · Mungert
Params7.26B
Context16K
Q4_K_M4.5 GB
CO
VL 1 Coder Heretic
Coder · haffner
Params7.62B
Context32K
Smallest1.4 GB
QU
quietstar 8 ahead
Quietstar · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
chinese text correction 1.5b
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5-VL-32B-Instruct
Qwen · Mungert
Params32.8B
Context125K
Q4_K_M20.1 GB
GE
gemma 4 12b it MTP
Gemma · cloudnathan5
Params423M
Context256K
Q4_K_M0.3 GB
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
DarkArtsForge__Asmodeus 24B v2
Asmodeus · Naphula-Archives
Params23.6B
Context128K
Q4_K_M14.3 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · andrijdavid
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
LL
Llama 3 Taiwan 8B Instruct
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB