Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · DoorZekor
Params16.4B
Context—
Q4_K_M10.8 GB
ST
sd3.5 large
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
PH
Phi 3 mini 4k instruct GGUF Imatrix smashed
Phi · PrunaAI
Params3.82B
Context4K
Q4_K_M2.4 GB
ST
stable diffusion 3.5 large
Stable · city96
Params8.15B
Context—
Smallest4.8 GB
SC
SCAIL 2 GGUF ComfyUI
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.5 GB
MI
MiniMax H3 comfyUI
Minimax · vantagewithai
Params33.1B
Context—
Q4_K_M19.9 GB
GR
Granite 4.0 H Tiny
Granite · ibm-granite
Params6.94B
Context1024K
Q4_K_M4.2 GB
QW
JoyFox-Qwen3.6-35B-A3B-RP-Aggressive
Qwen · joyfox
Params35.5B
Context256K
Q4_K_M21.7 GB
WA
Wan2.2 Fun A14B InP
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
MU
music flamingo
Music · henry1477
Params7.6B
Context32K
Smallest3.0 GB
ER
ERNIE Image Turbo
Ernie · unsloth
Params8.03B
Context—
Q4_K_M5.0 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
GR
Granite 4.0 H Micro
Granite · ibm-granite
Params3.2B
Context1024K
Q4_K_M1.9 GB
PH
Phi 3 mini 128k instruct GGUF Imatrix smashed
Phi · PrunaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
FI
FireRed Image Edit 1.1
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
PH
gretelai Phi 3 mini 128k instruct
Phi · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
SC
SCAIL Preview
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
FL
flux2 dev
Flux · gguf-org
Params17.8B
Context—
Q4_K_M20.0 GB
VI
Violet Twilight v0.2
Violet · Epiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5-7B-Instruct-1M
Qwen · Mungert
Params7.6B
Context986K
Q4_K_M4.8 GB
LL
tachyphylaxis Meta Llama 3.1 Chat Uncensored
Llama · RichardErkhov
Params15M
Context—
Q4_K_M0.0 GB
LT
ltxv0.9.6
Ltx · calcuis
Params1.92B
Context—
Q4_K_M1.4 GB
AC
ace
Ace · calcuis
Params3.31B
Context—
Q4_K_M0.1 GB
LL
KISTI KONI KONI Llama3 8B Instruct 20240729
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
QW
Qwen3.6 35B A3B abliterated v2
Qwen · LMLiutenant
Params34.7B
Context256K
Q4_K_M21.2 GB
WA
Wan2.2 Fun 5B Control
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
MI
MiniCPM OCR Jev
MiniCPM · openbmb
Params1.88B
Context256K
Q4_K_M1.3 GB