GGUF models by Manojb
345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest19.4 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · Manojb
Params23.6B
Context384K
Smallest11.5 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.3 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.2 GB
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.4 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest2.5 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest10.0 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest1.5 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest14.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.1 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.2 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.0 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.5 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.2 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest4.5 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.4 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest8.8 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest1.2 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest13.5 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest17.3 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · Manojb
Params23.6B
Context384K
Smallest10.4 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest2.0 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest17.6 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.5 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.2 GB
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest22.1 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.7 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.6 GB