Q5_K_S GGUF models

5-bit k-quant, small. Closer to the original quality than Q4, at a larger size. 103100 models have a Q5_K_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 4k Instruct
Phi · second-state
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LU
luxia 21.4b alignment v1.0
Luxia · MaziyarPanahi
Params21.4B
Context32K
Q4_K_M12.9 GB
GGUF
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
RW
rwitz_go-bruins
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Medgemma 27b Text It Abliterated
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
KA
karakuri-lm-8x7b-instruct-v0.1
Karakuri · mmnga
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NE
models--automerger--NeuralsirkrishnaInex12-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
AstaBrief_8B
Astabrief · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
LL
Llama-3-8B-Instruct-262k
Llama · crusoeai
Params8B
Context256K
Q4_K_M4.9 GB
GGUF
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool useVision
SH
Shaylah Darija 4b Merged
Shaylah · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
ZO
Zoro i1
Zoro · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningRoleplayVision
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
NE
Nex N2.5 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M250.8 GB
Vision
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool use
DO
DoItYourself v1 2B
Doityourself · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
HE
Hermes 2 DPO WestLake 7B v2
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Tool use
QW
Twi Qwen v1 Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
CY
CyberStrike OffSec 35B
Cyberstrike · ahmedandaloes
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
ME
MechVL 4B RL
Mechvl · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningVision
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
GGUF
LL
Nous Hermes Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
SO
SOR ColdBrew 12B Think RP Base
Sor · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
SN
SniffyOtter 7B
Sniffyotter · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing