GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest17.3 GB
QW
Qwen3.8 27B
Qwen · Thireus
Params3B
Context256K
Smallest2.4 GB
GL
GLM 4.7 Flash
GLM · Thireus
Params166.4B
Context198K
Smallest6.1 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest462.5 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ1 KT SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest148.1 GB
QW
Qwen3 4B Thinking 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.3 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest557.0 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.3 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.5 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ4 KS SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest546.9 GB
KI
Kimi K2 Thinking THIREUS IQ1 S R4 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest193.7 GB
GL
GLM 4.7 Flash
GLM · Thireus
Params166.4B
Context198K
Smallest16.9 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest4.0 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest510.4 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ3 S SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest441.7 GB
GL
GLM 4.7 THIREUS IQ3 K SPECIAL SPLIT
GLM · Thireus
Params358B
Context198K
Smallest154.3 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.1 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.1 GB
QW
Qwen3 4B Thinking 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.8 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ3 K SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest441.7 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ2 BN SPECIAL SPLIT
Kimi · Thireus
Params5376B
Context256K
Smallest258.3 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest397.8 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest118.1 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest125.4 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params672B
Context160K
Smallest147.6 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest8.1 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest52.0 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.6 GB