GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest105.7 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest59.9 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.5 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ2 KT SPECIAL SPLIT
Kimi · Thireus
Params5376B
Context256K
Smallest274.4 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest117.5 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest249.9 GB
GL
GLM 4.7 THIREUS IQ4 KT SPECIAL SPLIT
GLM · Thireus
Params3360B
Context198K
Smallest179.9 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.3 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ2 K SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest305.4 GB
KI
Kimi K2 Thinking THIREUS Q5 K SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest579.4 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest206.5 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest249.9 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest62.2 GB
KI
Kimi K2 Instruct 0905 THIREUS Q6 0 R4 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest834.5 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest237.1 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest255.8 GB
QW
Qwen3 4B Thinking 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.7 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest390.3 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest89.8 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest52.1 GB
DE
DeepSeek V3.1 Terminus THIREUS Q3 K SPECIAL SPLIT
DeepSeek · Thireus
Params5120B
Context160K
Smallest288.8 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest52.0 GB
GL
GLM 4.7 THIREUS IQ5 KS R4 SPECIAL SPLIT
GLM · Thireus
Params3360B
Context198K
Smallest235.9 GB
GL
GLM 4.7 THIREUS Q4 0 SPECIAL SPLIT
GLM · Thireus
Params360B
Context198K
Smallest201.8 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest226.6 GB
GL
GLM 4.7 THIREUS IQ4 K SPECIAL SPLIT
GLM · Thireus
Params3360B
Context198K
Smallest201.8 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest337.1 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest120.7 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.0 GB