Q5_K_S GGUF models

5-bit k-quant, small. Closer to the original quality than Q4, at a larger size. 103100 models have a Q5_K_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 30B A3B Gemini Pro High Reasoning 2507 ABLITERATED UNCENSORED
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
AI
Airoboros L2 70B 2.1 Creative
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
KN
KnowLine 4B Gen5.5
Knowline · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GGUF
GU
Guanaco 13B Uncensored
Guanaco · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AS
astrollama 2 7b chat aic i1
Astrollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openchat_openchat_3.5
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama3.2 30B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params30B
Context128K
Q4_K_M18.4 GB
Roleplay
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
PH
Tess v2.5 Phi 3 medium 128k 14B i1
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
GL
GLM-4.7-Flash-Coder
GLM · ngquocvinh
Params30B
Context198K
Q4_K_M18.1 GB
Coding
QW
Qwen3.8 27B Fable Distill
Qwen · TeichAI
Params27.3B
Context256K
Q4_K_M17.4 GB
CodingVision
GL
GLM 4.5V
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
GGUF
LL
Llama 3.1 1 million cxt Dark Planet 8B
Llama · DavidAU
Params8B
Context1048K
Q4_K_M4.9 GB
Roleplay
MI
MiniCPM5 2B Claude Fable5 heretic
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · mradermacher
Params600M
Context32K
Q4_K_M0.4 GB
Vision
MI
Mistral dolphin mix cine open Ne NSFW
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
Eurus 70b sft fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
QW
Qwen3.8 2B
Qwen · piskle
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
WA
Wan2.1 I2V 14B FusionX
Wan · QuantStack
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
SW
Swallow-7b-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwythos 9B v2
Qwythos · bartowski
Params9.2B
Context1024K
Q4_K_M6.0 GB
Reasoning

Other quants

Keep browsing