Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
AP
Apertus 8B Instruct 2509 Heretic
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
QW
General Reasoner Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.8 27b Korean Uncensored Merged
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 Novelist 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Huihui Qwen3 4B Thinking 2507 Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
OPSD MiniCPM4.1 8B
MiniCPM · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
NA
NaNovel
Nanovel · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
FA
Fairy2i W2
Fairy · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
SE
Seed Coder 8B Base
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.6 35B A3B Abliterated MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HA
Hammer2.1 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
HO
Holo2 8B
Holo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama3.1 Gutenberg 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
LL
DeepICD R1 Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
L3.3 MS Nevoria 70b Heretic
Nevoria · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
PA
Pantheon Reasoning 31B 1.1
Pantheon · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL ST TNG IV
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
MA
Marco MT Algharb
Marco · mradermacher
Params14.8B
Context4K
Q4_K_M9.0 GB
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
GE
Gemma 4 26B A4B It Ara Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12B It Jbliterated v2
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B It ARA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
FR
FrogMini 14B 2510
Frogmini · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
NA
Napoleon 3.5 12B
Napoleon · mradermacher
Params10.7B
Context256K
Q4_K_M6.7 GB
SO
SOLAR 10.7B slerp i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 8B RP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB