Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
ST
stable diffusion 3.5 large
Stable · second-state
Params695M
Context—
Smallest0.7 GB
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
codellama_codellama-7b-instruct-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen Image Edit
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored
Qwen · 0bserverx
Params177B
Context256K
Q4_K_M119.2 GB
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · openbmb
Params389M
Context256K
Q4_K_M0.2 GB
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
LL
Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WA
Wan2.2 Fun A14B Control Camera
Wan · QuantStack
Params14.8B
Context—
Q4_K_M10.7 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
WA
Wan2.2 Fun A14B Control
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
BA
BarryFutureman NeuralTurdusVariant1 7B
Barryfutureman · RichardErkhov
Params7B
Context—
Q4_K_M0.0 GB
MI
MiniCPM V 4_6
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
HO
K2 Horizon 3.7B
Horizon · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
LL
VAGOsolutions Llama 3 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params6B
Context—
Q4_K_M0.0 GB
LT
LTX 2.5
Ltx · vantagewithai
Params21B
Context—
Q4_K_M15.7 GB
LL
Llama 3.2 3B Instruct abliterated
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
WI
ehartford_wizardlm-7b-uncensored
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
DE
deepseek-ai_deepseek-coder-33b-instruct
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
MI
open-orca_mistral-7b-openorca
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB