GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest11.8 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ4 KS SPECIAL SPLIT
DeepSeek · Thireus
Params5120B
Context160K
Smallest357.6 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.2 GB
GL
GLM 5.1 THIREUS IQ4 K SPECIAL SPLIT
GLM · Thireus
Params5632B
Context198K
Smallest426.4 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest24.1 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest8.0 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.2 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest3.3 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest1.9 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest20.2 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.3 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest77.3 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest2.3 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params396B
Context256K
Smallest134.0 GB
GL
GLM 5.1 THIREUS IQ5 K R4 SPECIAL SPLIT
GLM · Thireus
Params5632B
Context198K
Smallest519.3 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest8.2 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest17.8 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest24.1 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest9.0 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params569M
Context256K
Smallest0.2 GB
QW
Qwen3.5 27B
Qwen · Thireus
Params2.97B
Context256K
Smallest1.3 GB
GL
GLM 5.2 THIREUS IQ3 K SPECIAL SPLIT
GLM · Thireus
Params753B
Context1024K
Smallest324.2 GB
GL
GLM 5.2 THIREUS IQ3 S R4 SPECIAL SPLIT
GLM · Thireus
Params740B
Context1024K
Smallest324.2 GB
KI
Kimi K2 Thinking THIREUS IQ3 XXS SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest393.6 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.4 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.4 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params1.88B
Context256K
Smallest0.8 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params1.88B
Context256K
Smallest1.3 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest4.5 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest11.5 GB