GGUF models by Manojb
345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.6 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.5 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest7.4 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.6 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.8 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest8.4 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest16.0 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest1.5 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.6 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest2.4 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest17.5 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.1 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest8.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.3 GB
QW
qwen2.5 coder 7b instruct q6 k
Qwen · Manojb
Params7.62B
Context128K
Smallest6.3 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.8 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest13.3 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.9 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest14.0 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest15.5 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest2.8 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5 27B Q6 K
Qwen · Manojb
Params26.9B
Context256K
Smallest22.1 GB