GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GL
GLM 4.7 Flash
GLM · Thireus
Params166.4B
Context198K
Smallest15.1 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest270.3 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest79.3 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest125.1 GB
QW
Qwen3 4B Thinking 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest4.3 GB
GL
GLM 4.7 Flash
GLM · Thireus
Params166.4B
Context198K
Smallest7.6 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest101.2 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest118.1 GB
QW
Qwen3 4B Thinking 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.1 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest161.8 GB
GL
GLM 4.7 Flash
GLM · Thireus
Params29.9B
Context198K
Smallest7.6 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest462.5 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest127.0 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · Thireus
Params235B
Context256K
Smallest161.8 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · Thireus
Params480B
Context256K
Smallest270.3 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · Thireus
Params235B
Context256K
Smallest94.0 GB
KI
Kimi K2 Instruct 0905 THIREUS IQ3 XXS R4 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest393.6 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest154.8 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.8 GB
DE
DeepSeek V3.1 Terminus THIREUS Q8 0 SPECIAL SPLIT
DeepSeek · Thireus
Params670B
Context160K
Smallest713.3 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest161.8 GB
QW
Qwen3 VL 235B A22B Instruct
Qwen · Thireus
Params235B
Context256K
Smallest193.0 GB
QW
Qwen3 4B Instruct 2507
Qwen · Thireus
Params4.02B
Context256K
Smallest2.3 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest52.0 GB
GL
GLM 4.7 THIREUS IQ1 KT SPECIAL SPLIT
GLM · Thireus
Params358B
Context198K
Smallest79.2 GB
KI
Kimi K2 Thinking THIREUS IQ5 K R4 SPECIAL SPLIT
Kimi · Thireus
Params1030B
Context256K
Smallest579.4 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest125.1 GB
QW
Qwen3.8 27B
Qwen · Thireus
Params27B
Context256K
Smallest15.1 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params672B
Context160K
Smallest420.4 GB
QW
Qwen3.8 27B
Qwen · Thireus
Params3B
Context256K
Smallest0.9 GB