Q2_K_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Grok Oss Apollyon 24B
Grok · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LF
LFM2.5 Encoder 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
Coding
AT
ATLAS Teach 8B Instruct
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · ThomasBaruzier
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
DR
DREX 062225 Exp
Drex · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
GGUF
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Reasoning
MO
Mordant 7B Think
Mordant · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
GO
Goetia 26B A4B v1.3
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
NE
Nebula 8lang 7b
Nebula · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen2.5 4x7B Quad Coder Instruct 30B
Qwen · mradermacher
Params30.4B
Context32K
Q4_K_M18.5 GB
Coding
MI
Mistral Small 24B Roleplay V6
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
Mini Hydra
Mini · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
DA
Darwin 36B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
OR
Ornstein 27B SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
BO
Boulesis 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
TR
Tri 7B Base
Tri · mradermacher
Params7.53B
Context4K
Q4_K_M4.6 GB
GGUF
CY
Cydonia 24B v4.3 Heretic v2
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3 Coder 53B A3B Instruct TOTAL RECALL v2 MASTER CODER L
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoningTool use
MI
MiniCPM5 2B
MiniCPM · NANI-Nithin
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
Gemma 4 E4B It Mentalchat16K
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GU
Gumini 1B Base i1
Gumini · GuminiResearch
Params1.08B
Context32K
Q4_K_M0.7 GB
Tool use
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
VE
UI Venus Ground 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF

Other quants

Keep browsing