Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5-VL-3B-Instruct
Qwen · Mungert
Params3.1B
Context125K
Q4_K_M1.9 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · DavidAU
Params29.9B
Context198K
Q4_K_M18.5 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · desirel
Params16.4B
Context—
Q4_K_M10.8 GB
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
SA
Sao10K L3 8B Stheno v3.1
Sao · RichardErkhov
Params8B
Context—
Q4_K_M0.3 GB
QW
Qwen Image Edit Rapid AIO
Qwen · Phil2Sat
Params7.62B
Context125K
Q4_K_M4.7 GB
WA
Wan2.1 I2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen Image Layered
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
LO
LongCat Video Avatar 1.5 GGUF ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.1 GB
QW
SpaceTimee/Suri-Qwen-3.8-27B-Uncensored
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
MI
avemio digital mistral 7b Sft pretrain 6000 steps merge
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M0.1 GB
ST
stable diffusion 3.5 large
Stable · second-state
Params695M
Context—
Smallest0.7 GB
QW
Qwen Image Edit
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored
Qwen · 0bserverx
Params177B
Context256K
Q4_K_M119.2 GB
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · openbmb
Params389M
Context256K
Q4_K_M0.2 GB
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
WA
Wan2.2 Fun A14B Control Camera
Wan · QuantStack
Params14.8B
Context—
Q4_K_M10.7 GB
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
WA
Wan2.2 Fun A14B Control
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
BA
BarryFutureman NeuralTurdusVariant1 7B
Barryfutureman · RichardErkhov
Params7B
Context—
Q4_K_M0.0 GB
MI
MiniCPM V 4_6
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
LL
VAGOsolutions Llama 3 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params6B
Context—
Q4_K_M0.0 GB