Q5_K_S GGUF models

5-bit k-quant, small. Closer to the original quality than Q4, at a larger size. 103100 models have a Q5_K_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · llmfan46
Params79.7B
Context256K
Q4_K_M49.8 GB
Coding
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
CA
causallm_7b
TheBloke
Params7.72B
Context8K
Q4_K_M4.8 GB
Tool useVision
FA
FastH3 Omni
Fasth · Abiray
Params22.1B
Context—
Q4_K_M12.7 GB
GGUF
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
WI
wizardlm_wizardcoder-python-34b-v1.0
Wizardcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Reasoning
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
WI
Wicked Stuff 26B A4B v2.1 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LA
latxa-13b-v1.2
Latxa · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HO
K2 Horizon 7B Heretic
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
LL
jarradh_llama2_70b_chat_uncensored
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
MI
teknium_openhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision

Other quants

Keep browsing