Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
OL
Olmo 3 7B Instruct SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
llm-compiler-7b-ftd
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
LL
Llama 3.1 8B Instruct Jbliterated v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48B
Context256K
Q4_K_M32.0 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.5 2X7B Coder VisCoder Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
QW
Qwable 9B Claude Fable 5 OBLITERATED
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 Sex
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Aidc 5k Laos Gemma 3 4b It v2
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 7B
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
SC
Scout 8b
Scout · mradermacher
Params8.31B
Context32K
Q4_K_M5.1 GB
VI
VibeWorlder 30B A3B
Vibeworlder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
IO
IoGPT A1 Instruct i1
Iogpt · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3 06B 3MPER0RR Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
SC
Scout 4b
Scout · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
QW
Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
SenseNova U1.5 8B MoT
Sensenova · mradermacher
Params9.35B
Context256K
Q4_K_M5.7 GB
VI
VisCoder 7B
Viscoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB