Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
OM
Omega Evolution 9B v2.0
Omega · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 14B Ai Expert
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
AR
AReaL Boba 2 32B
Areal · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 32B Instruct CFT
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
EQ
Equinox 31B
Equinox · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
QwENDEAVR2.5 VL NoCNN i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AC
ActIO-UI-7B-SFT
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MO
L3.2 8X4B MOE V2 Dark Champion Inst 21B Uncen Ablit
Moe · mradermacher
Params21B
Context128K
Q4_K_M12.9 GB
QW
Qwen3 VL 8B Instruct Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ST
Starlight Mini
Starlight · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 0.8B Abliterated V2
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
PA
MS3.2 PaintedFantasy 24B
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
GE
Geodesic Phantom 12B
Geodesic · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
SM
SmolLM2 1.7B Instruct Heretic
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GP
Gpt Oss 120b Uncensored xCloud
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
GR
GroveMoE Base
Grovemoe · mradermacher
Params33B
Context32K
Q4_K_M20.2 GB
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
PU
Pusula Danisman Ai
Pusula · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
ST
Strawberrylemonade L3 70B v1.2
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ToolACE 2.5 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral 7B model 45k6e2e4 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 21B Claude 4.6 Opus Thinking EXP
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.8 GB
EV
EventMemAgent 8B
Eventmemagent · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ON
Oneirogen 7B
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 4 E4B It Heretic
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 19b A4B It REAP
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
ME
MedGemma GRPO
Medgemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
NeoHorse 1 9B
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB