GGUF models by Manojb
345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.
QW
Qwen3.5 0.8B Q4 K M
Qwen · Manojb
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5 4B Q8 0
Qwen · Manojb
Params4.21B
Context256K
Smallest4.5 GB
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.3 GB
QW
Qwen3.5 35B A3B Q4 K M
Qwen · Manojb
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest11.5 GB
QW
Qwen3.5 2B Q8 0
Qwen · Manojb
Params1.88B
Context256K
Smallest2.0 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.7 GB
QW
qwen3.5 9b null space abliterated q6 k
Qwen · Manojb
Params8.95B
Context256K
Smallest7.4 GB
QW
Qwen3.5 2B Q6 K
Qwen · Manojb
Params1.88B
Context256K
Smallest1.6 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.6 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest8.2 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest4.7 GB
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest11.5 GB
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest15.4 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.5 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.7 GB
MI
Devstral Small 2 24B Instruct 2512 Q4 K M
Mistral · Manojb
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest16.8 GB
QW
Crow 4B Opus 4.6 Distill Heretic Qwen3.5.Q4 K M
Qwen · Manojb
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 9B Abliterated
Qwen · Manojb
Params8.95B
Context256K
Smallest17.9 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.1 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest9.5 GB
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest6.0 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.5 GB
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.6 GB
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest8.6 GB