GGUF models by Manojb

345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 0.8B Q4 K M
Qwen · Manojb
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3.5 4B Q8 0
Qwen · Manojb
Params4.21B
Context256K
Smallest4.5 GB
ReasoningTool useVision
QW
Qwen3.5-2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.3 GB
ReasoningTool useVision
QW
Qwen3.5 35B A3B Q4 K M
Qwen · Manojb
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest11.5 GB
ReasoningTool use
QW
Qwen3.5 2B Q8 0
Qwen · Manojb
Params1.88B
Context256K
Smallest2.0 GB
ReasoningTool useVision
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.7 GB
ReasoningTool useVision
QW
qwen3.5 9b null space abliterated q6 k
Qwen · Manojb
Params8.95B
Context256K
Smallest7.4 GB
ReasoningTool useVision
QW
Qwen3.5 2B Q6 K
Qwen · Manojb
Params1.88B
Context256K
Smallest1.6 GB
ReasoningTool useVision
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.6 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.4 GB
ReasoningTool useVision
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest8.2 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest4.7 GB
ReasoningTool useVision
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest11.5 GB
ReasoningTool use
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest15.4 GB
ReasoningTool use
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.5 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.7 GB
ReasoningTool useVision
MI
Devstral Small 2 24B Instruct 2512 Q4 K M
Mistral · Manojb
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool use
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Manojb
Params34.7B
Context256K
Smallest16.8 GB
ReasoningTool useVision
QW
Crow 4B Opus 4.6 Distill Heretic Qwen3.5.Q4 K M
Qwen · Manojb
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 9B Abliterated
Qwen · Manojb
Params8.95B
Context256K
Smallest17.9 GB
ReasoningTool use
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.1 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest5.4 GB
ReasoningTool useVision
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest9.5 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
ReasoningTool useVision
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest6.0 GB
ReasoningTool useVision
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.5 GB
ReasoningTool useVision
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.6 GB
ReasoningTool useVision
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.5 GB
ReasoningTool useVision
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest8.6 GB
ReasoningTool use

Keep browsing