Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
MI
MiniCPM5 1B
MiniCPM · RemySkye
Params1.08B
Context128K
Q4_K_M0.7 GB
LL
Llama 3.3 8B Instruct 128K Absolute Heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
MiniMax M2.1 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
GE
Gemma 3 27b It Gemini Deep Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SA
Satella-30B-A3B
Satella · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
LI
Ling 3.0 Tiny Heretic
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
FL
FluentlyQwen3 Coder 4B
Fluentlyqwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
GR
Granite 4.0 H Tiny Base
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
QW
Qwen3 Blitzar Coder F1 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB
OR
Ornith 1.5 9B Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
EU
EuroLLM 9B Instruct 2512
Eurollm · mradermacher
Params9.15B
Context32K
Q4_K_M5.6 GB
NE
Newton Bot 2A Standard_Merged
Newton · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
BI
Bielik Minitron 7B v3.0 Instruct Ungated
Bielik · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
QW
Qwen3.5 27B Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CN
CNY 7B i1
Cny · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MY
Mystic Matron 12B
Mystic · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
QW
PersianSciQA Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
LexiFreak 8B Unleashed
Lexifreak · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DU
DukunLM 7B V1.0 Uncensored i1
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
MU
Muse Glimmer 30B Tachibana Agent
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
GE
Gervasio 8b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GP
Gpt Oss 20b Esper3.1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
DE
Gemma 3 12b It Vl Deepseek v3.1 Heretic Uncensored Thinking
DeepSeek · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB