Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
MI
MiniMax M2.1 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
HO
K2 Horizon 7B GMCE i1
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
MA
Maginum Cydoms 24B Absolute Heresy
Maginum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
SearchQwen3 8B
Searchqwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 4B MultiDistill Megamix 8xMerge UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
Huihui Ministral 3 14B Reasoning 2512 Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
PR
Prototype X 12b
Prototype · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
Morrow 2.6B
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
MI
Mira 1 Large 0919
Mira · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
PL
PlanoO Zirelum
Planoo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
VI
Vicuna 13b v1.5
Vicuna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.5 4B NSFW ARA Heretic Literotica
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3 Deckard Large Almost Human 6B
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
RiverCub Gemma 3 27B Impotent Heresy
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.3 70B o1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
QW
Qwen3.5 Creative 19B A3B REAP
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
QW
Qwen3-VL-8B-Instruct
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
RE
Rei V2 12B i1
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Llama 3 8B Instruct
Llama · hermes42
Params8B
Context8K
Q4_K_M4.9 GB
PA
panda coder 13B i1
Panda · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
ME
II Medical 8B
Medical · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
AR
Aronnax-N9Bv2-1.0
Aronnax · mradermacher
Params8.9B
Context1024K
Q4_K_M6.5 GB