Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
FI
Finch 7b
Finch · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
IM
imgmodel
Imgmodel · koboldcpp
Params3.47B
Context40K
Q4_K_M2.5 GB
LL
MiniCPM Llama3 V 2 5
Llama · openbmb
Params8.2B
Context8K
Q4_K_M4.9 GB
LL
FILM6912 Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
MI
MiniCPM V 4
MiniCPM · openbmb
Params3.6B
Context32K
Q4_K_M2.2 GB
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
flux imatrix
Flux · Eviation
Params11.9B
Context—
Q4_K_M6.7 GB
YI
Yi 1.5 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
4 alokk llama 3 8b English to Hinglish
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
CH
Chroma1 Flash
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LT
LTX 2
Ltx · vantagewithai
Params18.9B
Context—
Q4_K_M12.8 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
QW
Qwen Image Edit
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
CO
CohereForAI aya 23 35B
Cohereforai · RichardErkhov
Params35B
Context—
Q4_K_M0.0 GB
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
MI
Mistral 7B Instruct v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
FU
Fun CosyVoice3 0.5B 2512
Fun · Lourdle
Params859M
Context—
Q4_K_M0.6 GB
QW
Qwen2.5-VL-7B-Instruct
Qwen · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
WA
Wan2.2 Fun 5B InP
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB