GGUF models by Manojb
345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest13.0 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest7.7 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.2 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.3 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.4 GB
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest7.3 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.9 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.6 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.0 GB
QW
qwen3.5 9b null space abliterated q8 0
Qwen · Manojb
Params8.95B
Context256K
Smallest9.5 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.5 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.6 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.8 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.7 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest16.6 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.7 GB
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest8.4 GB
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest11.2 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest4.0 GB
GG
ggml model Q4 K M
Ggml · Manojb
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Q4_K_M0.6 GB
QW
Qwen3.5 0.8B Q6 K
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.8 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.5 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.2 GB
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Q4_K_M9.0 GB