Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5 2B
Qwen · ZuzeTt
Params1.88B
Context256K
Q4_K_M1.3 GB
TI
TinyLlama 1.1B intermediate step 1431k 3T
Tinyllama · andrijdavid
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
Qwen3.5 4B BE
Qwen · taronaeo
Params4.33B
Context256K
Q4_K_M2.8 GB
MI
Candle Mistral Trismegistus 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
PH
tuong nguyen prd Phi 3.5 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
SA
SambaLingo Arabic Base
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GE
Gemma Ataraxy Dare 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 4B Thinking 2507
Qwen · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
BI
BioMistral BioMistral 7B TIES
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2 0.5B
Qwen · QuantFactory
Params494M
Context128K
Q4_K_M0.4 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · QuantFactory
Params2.67B
Context32K
Q4_K_M1.6 GB
RO
roadz dv finetuned 211124
Roadz · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
liyimengwork llama 3.1 8B wenyanwen2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LT
LTX 2.3
Ltx · bleckhert
Params21B
Context—
Q4_K_M14.3 GB
MI
Harbinger-24B
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
CY
Cydonia 22B v1.2 i1
Cydonia · BasedAGI
Params22.2B
Context32K
Q4_K_M13.3 GB
LI
lightblue reranker 0.5 bincont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
QW
Qwen2.5 Math 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
deepseek math 7b rl
DeepSeek · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.0 H Micro BE
Granite · taronaeo
Params3.19B
Context1024K
Q4_K_M1.9 GB
GL
granite 4.0 h 1b DISTILL glm 4.7 think
GLM · glogwa68
Params1.46B
Context1024K
Q4_K_M0.9 GB
QW
Qwen3.5 0.8B
Qwen · titan0115
Params752M
Context256K
Q4_K_M0.5 GB
LL
llava
LLaVA · calcuis
Params6.74B
Context4K
Q4_K_M4.1 GB
BO
Boris 250M Instruct
Boris · opencerebral
Params250M
Context1K
Q4_K_M0.2 GB
LL
Llama3.1 ArrowSE v0.4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GR
granite 4.0 h 350m DISTILL gemini think
Granite · glogwa68
Params340M
Context1024K
Q4_K_M0.2 GB