Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
GE
GemPT 26B A4B
Gempt · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
FL
FluentlyLM Prinum Abliterated
Fluentlylm · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GP
Gpt Oss 46b
gpt-oss · mradermacher
Params45.7B
Context128K
Q4_K_M34.5 GB
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GP
Gpt Oss Nano
gpt-oss · mradermacher
Params8.97B
Context128K
Q4_K_M6.8 GB
LL
Llama portuguese 13b Luana v0.2 i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
RO
RoLlama2 7b Instruct DPO 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CO
CodeFuse SVR 8B
Codefuse · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ZE
Zen Vl 8b Instruct
Zen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GE
Liujgoj Cantonese Gemma 4 12B It Sft
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
FI
Firefly v6 DONTDOWNLOAD STILLONPROGRESS
Firefly · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
UI
UIGEN T3 32B Preview
Uigen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
Midas FableAgent 8B
Midas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GO
GoLongRL 30B A3B
Golongrl · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mirai 70B 1.0
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
DeepHermes 3 Mistral 24B Preview i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 19b A4B It REAP Heretic
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GI
GigaChat3.1 Lightning Uncensored
Gigachat · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
RO
Rocinante XL 16B v1 Absolute Heresy
Rocinante · mradermacher
Params16.1B
Context128K
Q4_K_M9.7 GB
QW
Qwen3.5 9B Janus Abliterated V2 Safetensors
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 27B Ultra Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 8B 192k Context 6X Josiefied Uncensored
Qwen · mradermacher
Params8.19B
Context192K
Q4_K_M5.0 GB
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SE
SelfCite 8B CC SFT i1
Selfcite · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8 27B 3MPER0RR Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DO
Dolphin Email 8b
Dolphin · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
WE
WeirdCompound v1.7 24b Absolute Heresy Noslop
Weirdcompound · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB