GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest16.3 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest17.3 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params35B
Context256K
Smallest10.8 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params35B
Context256K
Smallest18.8 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.1 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest0.9 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest1.0 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params4.05B
Context256K
Smallest2.7 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params2.97B
Context256K
Smallest1.2 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest16.3 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest358.1 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params670B
Context160K
Smallest378.4 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ1 M SPECIAL SPLIT
DeepSeek · Thireus
Params650B
Context160K
Smallest147.4 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest0.9 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest2.1 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest3.5 GB
QW
Qwen3.5 9B
Qwen · Thireus
Params8.95B
Context256K
Smallest4.8 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params396B
Context256K
Smallest170.8 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest10.1 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.2 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params756M
Context256K
Smallest0.8 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest5.9 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params2.97B
Context256K
Smallest0.8 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest1.3 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest551.8 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params672B
Context160K
Smallest289.2 GB
QW
Qwen3 VL 235B A22B Thinking
Qwen · Thireus
Params235B
Context256K
Smallest125.1 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.2 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.2 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest0.4 GB