Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
SR
SRA RiskGate 4B
Sra · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
GP
Gpt Oss 20b Gemini 2.5 Pro Distill
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
SM
SmolVLM2 256M Video Instruct
Smolvlm · mradermacher
Params163M
Context8K
Q4_K_M0.1 GB
VI
Video Thinker 7B
Video · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
Mira v1.12.1 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
OS
Ostblock 12B
Ostblock · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
0bserverx Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · jaromer
Params26.9B
Context256K
Q4_K_M16.5 GB
ZU
Zurich 7B GCv2 5m
Zurich · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
L3.1 Dark Reasoning Dark Planet Hermes R1 Uncensored Horror Imatrix MAX 8B
Dark · ScottzillaSystems
Params8.03B
Context128K
Q4_K_M5.5 GB
QW
PAPO D Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Big Tiger Gemma 27B v3 Heretic v2
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
GemmaX2 28 9B v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
RA
Raven 8B v1
Raven · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
QW
General Reasoner Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
KI
Kitsune Tales E4B EN
Kitsune · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GL
GLM 4.6 REAP 268B A32B Derestricted
GLM · mradermacher
Params268B
Context198K
Q4_K_M162.3 GB
HU
Huggy 2 1k Alpaca
Huggy · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
JA
Jais Family 6p7b
Jais · mradermacher
Params7.14B
Context2K
Q4_K_M6.4 GB
LF
LFM 2.6B Claude4.8 GPT 5.6 Sol Grok 4.6_Fable5 Distilled
Lfm · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
AG
AgenticQwen 8B
Agenticqwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CH
ChemWiz_16bit
Chemwiz · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ME
Meteor v4 2048
Meteor · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
CU
Custom KoLLM 13B v3 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
RL
RLVR 8B 0926
Rlvr · mradermacher
Params8.19B
Context320K
Q4_K_M5.0 GB
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
LO
Looking Glass Alice Thinking NSFW RP
Looking · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GP
Codegpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
WR
Wraith 8b Heretic
Wraith · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB