GGUF models by Thireus
2513 GGUF models quantized by Thireus on Hugging Face. Sizes run from 275M to 5632B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest15.4 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest17.3 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest17.3 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params396B
Context256K
Smallest87.8 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.1 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.1 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.2 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params569M
Context256K
Smallest0.2 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params569M
Context256K
Smallest0.2 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params569M
Context256K
Smallest0.4 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params4.05B
Context256K
Smallest0.8 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest1.9 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest1.9 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest2.2 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest3.3 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest4.9 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest5.7 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest8.4 GB
GE
Gemma 4 31B It
Gemma · Thireus
Params30.7B
Context256K
Smallest13.2 GB
QW
Qwen3.5 0.8B
Qwen · Thireus
Params275M
Context256K
Smallest0.1 GB
QW
Qwen3.5 2B
Qwen · Thireus
Params569M
Context256K
Smallest0.2 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params756M
Context256K
Smallest0.2 GB
QW
Qwen3.5 4B
Qwen · Thireus
Params756M
Context256K
Smallest0.3 GB
QW
Qwen3.5 35B A3B
Qwen · Thireus
Params1.86B
Context256K
Smallest0.5 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params4.05B
Context256K
Smallest1.6 GB
QW
Qwen3.5 122B A10B
Qwen · Thireus
Params4.05B
Context256K
Smallest1.8 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest2.4 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest2.6 GB
QW
Qwen3.5 397B A17B
Qwen · Thireus
Params8.63B
Context256K
Smallest5.7 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ6 K SPECIAL SPLIT
DeepSeek · Thireus
Params5120B
Context160K
Smallest556.2 GB