Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
XL
xLAM 8x7b R
Xlam · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
RE
reader lm 0.5b
Reader · QuantFactory
Params630M
Context250K
Q4_K_M0.5 GB
KR
kromeurus L3.1 Ablaze Vulca v0.1 8B
Kromeurus · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Nekomata 7b Pfn Qfin
Nekomata · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
Firefly Qwen1.5 En 7b
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
NA
Narwhal-7b-v3
Narwhal · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
granite 4.0 h 1b DISTILL glm 4.7
GLM · glogwa68
Params1.46B
Context1024K
Q4_K_M0.9 GB
NI
NIHAPPY L3.1 8B v0.09
Nihappy · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
tulu-2-dpo-70b
Tulu · RichardErkhov
Params69B
Context8K
Q4_K_M41.4 GB
LL
Llama 3.1 8B OmniMatrix
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
NO
notHumpback-M0
Nothumpback · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
SA
sarashina2 7b
Sarashina · QuantFactory
Params7.32B
Context4K
Q4_K_M4.5 GB
GR
granite-8b-code-base-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
GE
gemma portuguese luana 2b
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
DA
3dAnimationDiffusion v10
Danimation · second-state
Params1.07B
Context—
Smallest0.2 GB
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · ThomasBaruzier
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama-3-Refueled
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · botp
Params29.9B
Context198K
Q4_K_M18.5 GB
QW
Qwen3.6 27B Claude Opus Reasoning Distill v2 heretic
Qwen · fzcfweasdferttgg
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama 3 Swallow 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
SeaLLMs v3 1.5B
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5-7B-Instruct
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
GR
granite-20b-code-base-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
MI
Bigstral 12b 32k
Mistral · QuantFactory
Params12.5B
Context32K
Q4_K_M7.5 GB
QW
Qwen2 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llama 3 8B Instruct 262k
Llama · QuantFactory
Params8.03B
Context256K
Q4_K_M4.9 GB
GP
Gpt Oss 20b Cve Cybersecurity
gpt-oss · piotreknow02
Params20.9B
Context128K
Q4_K_M15.8 GB