Q4_K_S GGUF models
4-bit k-quant, small. Slightly smaller and a little lower quality than Q4_K_M. 104639 models have a Q4_K_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LT
LTX2.3 10Eros 1.4 Split
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Artemis 31B v1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
TO
ToriiGate 0.5
Toriigate · DraconicDragon
Params4.84B
Context256K
Q4_K_M3.1 GB
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest3.1 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
JE
Jebadiah 27b v2 1
Jebadiah · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Humanish Roleplay Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
NE
Neuralgamma 2.5 7B slerp
Neuralgamma · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
QW
14B Qwen2.5 Kunou v1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB