GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest11.8 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest53.8 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.1 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest1.0 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest1.7 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest4.9 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest17.3 GB
QW
Qwen3.5 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest7.0 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params122B
Context256K
Smallest52.6 GB
KI
Kimi K2.5
Kimi · Thireus
Params1030B
Context256K
Smallest546.9 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest6.8 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest7.2 GB
QW
Qwen3.6 27B
Qwen · Thireus
Params26.9B
Context256K
Smallest22.1 GB
QW
Qwen3.5 27B
Qwen · Thireus
Params2.97B
Context256K
Smallest1.1 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest0.5 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params4.05B
Context256K
Smallest2.2 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest8.2 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ4 K SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest377.9 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params1.88B
Context256K
Smallest3.8 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params752M
Context256K
Smallest1.5 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params4.21B
Context256K
Smallest0.8 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest7.7 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest10.4 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest11.2 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params122B
Context256K
Smallest52.6 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params122B
Context256K
Smallest91.7 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params122B
Context256K
Smallest99.4 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params396B
Context256K
Smallest211.0 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest15.2 GB
QW
Qwen3.6 35B A3B
Qwen · Thireus
Params34.7B
Context256K
Smallest28.3 GB