GGUF models by Manojb
345 GGUF models quantized by Manojb on Hugging Face. Sizes run from 331M to 79.7B parameters. The longest trained context is 488K tokens.
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest16.9 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · Manojb
Params23.6B
Context384K
Smallest12.4 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest10.5 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.5 GB
LF
Lfm2-8B-A1B
Lfm · Manojb
Params8.34B
Context125K
Smallest5.9 GB
MI
Devstral Small 2 24B Instruct 2512 Q3 K L
Mistral · Manojb
Params23.6B
Context384K
Smallest12.4 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.6 GB
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus Distill.q4 k m
Nemotron · Manojb
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest18.7 GB
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest15.7 GB
QW
Qwen3.5 27B Heretic v2
Qwen · Manojb
Params26.9B
Context256K
Smallest15.6 GB
LI
Ling Coder Lite
Ling · Manojb
Params16.8B
Context4K
Smallest8.7 GB
QW
Qwen3 Coder Next f16
Qwen · Manojb
Params79.7B
Context256K
Smallest159.5 GB
QW
QwQ 32B Abliterated
Qwen · Manojb
Params32.8B
Context128K
Smallest14.8 GB
QW
Qwen3 14B GPT 5.2 High Reasoning Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest6.7 GB
PH
phi 4 reasoning vision q5 k m
Phi · Manojb
Params14.7B
Context32K
Smallest10.6 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.9 GB
LF
Lfm2-8B-A1B
Lfm · Manojb
Params8.34B
Context125K
Smallest9.0 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest15.8 GB
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.3 GB
QW
Qwen3 14B GPT 5.2 Distill.q4 k m
Qwen · Manojb
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 14B Claude 4.5 Opus Distill
Qwen · Manojb
Params14.8B
Context40K
Smallest8.6 GB
QW
Qwen3.5 4B Heretic
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
FL
flux game
Flux · Manojb
Params12B
Context—
Smallest9.3 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.0 GB
LF
LFM2 24B A2B Q4 0
Lfm · Manojb
Params23.8B
Context125K
Smallest13.5 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest8.5 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.3 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.6 GB
GG
ggml model Q3 K M
Ggml · Manojb
Params20.9B
Context128K
Smallest12.9 GB