Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
WA
wan 1.3b
Wan · Hagwell
Params127M
Context—
Q4_K_M1.0 GB
GE
dolphin 2.8 gemma 2b
Gemma · pabloce
Params3.03B
Context8K
Q4_K_M1.9 GB
SK
SkyReels V2 T2V 14B 720P VACE
Skyreels · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
ML
mlfoundations dev stackoverflow 5000tasks .75p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Research Reasoner 7B v0.3
Mistral · Raymond-dev-546730
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Ellaria 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
TE
Teuken 7B instruct commercial v0.4
Teuken · QuantFactory
Params8.48B
Context4K
Q4_K_M5.6 GB
TI
Tiny-Pirate-1.1b-v0.1
Tiny · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
FO
Foundation Sec 8B Instruct GGUF
Foundation · 2p8xx
Params8.03B
Context128K
Q4_K_M4.9 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
MI
openaudio
Mini · calcuis
Params695M
Context—
Q4_K_M1.0 GB
NX
Nxcode CQ 7B Orpo
Nxcode · duyntnet
Params7.25B
Context64K
Q4_K_M4.7 GB
ZE
zeta
Zeta · brittlewis12
Params7.62B
Context32K
Q4_K_M4.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · RichardErkhov
Params34.4B
Context8K
Q4_K_M20.7 GB
LL
BramVanroy llama2 13b ft mc4 nl cleaned tiny
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 3.1 8B
Llama · chatpig
Params8.03B
Context8K
Q4_K_M4.9 GB
FU
FusionNet
Fusionnet · RichardErkhov
Params21.2B
Context4K
Q4_K_M12.7 GB
DI
Diksha2001 VLLM new
Diksha · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LE
Lens Turbo GGUF ComfyUI
Lens · vantagewithai
Params4.1B
Context—
Q4_K_M2.5 GB
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
vicgalle Configurable Llama 3 8B v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtral-8x7B-Instruct-v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen Image Edit 2511
Qwen · toxicdog
Params20.4B
Context—
Q4_K_M13.2 GB
LT
LTX 2.3
Ltx · Julien33270
Params21B
Context—
Q4_K_M14.3 GB
LL
Dolphin3.0-Llama3.2-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
FA
Falcon3 10B Instruct
Falcon · QuantFactory
Params10.3B
Context32K
Q4_K_M6.3 GB
GE
Gemma 7b Aps It
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
CH
Christoph LSN gpt2 finetuned on metadata
Christoph · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB