Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
WA
Magic Wan Image V2
Wan · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
QW
dolphin-2.9.3-qwen2-1.5b
Qwen · crusoeai
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
LLaMA2 13B Psyfighter2
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
QW
Jan-v2-VL-high
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
LO
LongCat Image
Longcat · vantagewithai
Params6.27B
Context—
Q4_K_M3.7 GB
LT
LTX2.3 10Eros 1.2
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
SD
SDXL Lightning
Sdxl · mzwing
Params3.47B
Context—
Smallest2.6 GB
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
GE
gemma 4 e2b yemeni arabic assistant
Gemma · yemeni-ai-lab
Params4.63B
Context128K
Q4_K_M3.4 GB
MA
mamba 130m hf
Mamba · QuantFactory
Params129M
Context1024K
Q4_K_M0.1 GB
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · kepom
Params7.6B
Context32K
Q4_K_M4.7 GB
JA
Jan-v3-4b-base-instruct
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Qwenseek 3.8 27B CyberLite BF16
Qwen · trjxter
Params27.3B
Context256K
Q4_K_M16.8 GB
YI
Yi 1.5 34B Chat 16K
Yi · RichardErkhov
Params34.4B
Context16K
Q4_K_M20.7 GB
LL
Llama-2-7b-WikiChat-fused
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
K2 Horizon 7B
Horizon · NANI-Nithin
Params9B
Context512K
Q4_K_M5.6 GB
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
GP
gpt2 GGUF smashed
Gpt · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
LL
Na0s Llama 3.1 8b Pruned 4 Layers
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
TI
Tinyllama-Cinder-1.3B-Reason-Test
Tinyllama · RichardErkhov
Params1.28B
Context2K
Q4_K_M0.8 GB
SM
SmolLM2 360M
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
PH
Phi 3 mini 128k instruct imatrix
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
MI
Young Children Storyteller Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB