Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 20b Functioncalling
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GGUF
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Granite 20b Code Base R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
AU
AuraFlow v0.3
Auraflow · city96
Params6.86B
Context—
Q4_K_M4.0 GB
GGUF
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
Reasoning
SM
SmolLM 135M
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
GR
Granite 8b Code Base 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
WA
Wan Move 14B 480P
Wan · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
BE
Bernini R GGUF ComfyUI
Bernini · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
YI
01 ai Yi 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
CL
clef flash
Clef · NANI-Nithin
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
YI
01 ai Yi 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · SanctumAI
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · ThomasBaruzier
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
HU
HunyuanVideo I2V
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
GL
AutoGLM Phone 9B
GLM · Luckybalabala
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision
IM
Z Image Turbo
Image · vantagewithai
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
QW
Qwen Image Edit 2511
Qwen · vantagewithai
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
BR
Breeze-7B-Instruct-v0_1
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
SW
Swallow 13b Instruct v0.1
Swallow · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
WA
Wan2.1 I2V 14B FusionX
Wan · QuantStack
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
MI
Ministral-3-3B-Reasoning-2512
Mistral · Mungert
Params3.43B
Context256K
Q4_K_M2.2 GB
Reasoning
FL
FLUX.1 dev
Flux · second-state
Params123M
Context—
Smallest0.1 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
ME
Hy Memory 30B A3B
Memory · vinnipukh
Params30B
Context256K
Q4_K_M18.2 GB
GGUF

Other quants

Keep browsing