GGUF models by Manojb

345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest16.9 GB
ReasoningTool use
MI
Devstral Small 2 24B Instruct 2512
Mistral · Manojb
Params23.6B
Context384K
Smallest12.4 GB
CodingTool use
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest10.5 GB
ReasoningTool use
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.5 GB
ReasoningTool useVision
LF
Lfm2-8B-A1B
Lfm · Manojb
Params8.34B
Context125K
Smallest5.9 GB
Tool use
MI
Devstral Small 2 24B Instruct 2512 Q3 K L
Mistral · Manojb
Params23.6B
Context384K
Smallest12.4 GB
CodingTool use
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.6 GB
ReasoningTool use
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus Distill.q4 k m
Nemotron · Manojb
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest18.7 GB
ReasoningTool use
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest15.7 GB
ReasoningTool use
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest15.6 GB
ReasoningTool use
LI
Ling Coder Lite
Ling · Manojb
Params16.8B
Context4K
Smallest8.7 GB
Coding
QW
Qwen3 Coder Next f16
Qwen · Manojb
Params79.7B
Context256K
Smallest159.5 GB
CodingTool use
QW
QwQ 32B Abliterated
Qwen · Manojb
Params32.8B
Context128K
Smallest14.8 GB
ReasoningTool use
QW
Qwen3 14B GPT 5.2 High Reasoning Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest6.7 GB
ReasoningTool use
PH
phi 4 reasoning vision q5 k m
Phi · Manojb
Params14.7B
Context32K
Smallest10.6 GB
ReasoningVision
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.9 GB
ReasoningTool use
LF
Lfm2-8B-A1B
Lfm · Manojb
Params8.34B
Context125K
Smallest9.0 GB
Tool use
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest15.8 GB
ReasoningTool use
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.3 GB
ReasoningTool use
QW
Qwen3 14B GPT 5.2 Distill.q4 k m
Qwen · Manojb
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
ReasoningTool useVision
FL
flux game
Flux · Manojb
Params12B
Context—
Smallest9.3 GB
GGUF
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.0 GB
ReasoningTool useVision
LF
LFM2 24B A2B Q4 0
Lfm · Manojb
Params23.8B
Context125K
Smallest13.5 GB
Tool use
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest8.5 GB
ReasoningTool use
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.3 GB
ReasoningTool use
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.6 GB
ReasoningTool use
GG
ggml model Q3 K M
Ggml · Manojb
Params20.9B
Context128K
Smallest12.9 GB
Tool use

Keep browsing