GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest62.2 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest161.8 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest147.1 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest76.0 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest52.1 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest442.1 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest76.0 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest63.0 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest66.5 GB
GL
GLM 4.5 Air
GLM · Thireus
Params120B
Context128K
Smallest99.0 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest1.2 GB
KI
Kimi K2 Thinking THIREUS IQ2 XS SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest297.4 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest161.8 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest66.5 GB
KI
Kimi K2 Instruct 0905 THIREUS Q8 K R8 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest1035.0 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ4 XS SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest356.9 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
GL
GLM 4.5 Air
GLM · Thireus
Params110B
Context128K
Smallest24.4 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest249.9 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ4 K SPECIAL SPLIT
Kimi · Thireus
Params5376B
Context256K
Smallest578.0 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest80.3 GB
KI
Kimi K2 Instruct 0905 THIREUS Q8 0 R8 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest1091.1 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ2 KS SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest281.9 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ4 NL R4 SPECIAL SPLIT
Kimi · Thireus
Params1000B
Context256K
Smallest577.9 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest255.3 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest73.7 GB
GL
GLM 4.7 THIREUS IQ4 KS R4 SPECIAL SPLIT
GLM · Thireus
Params358B
Context198K
Smallest191.1 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.8 GB
GL
GLM 4.5 Air
GLM · Thireus
Params1203.2B
Context128K
Smallest89.8 GB