GGUF models by noctrex
173 GGUF models quantized by noctrex on Hugging Face. Sizes run from 1M to 396B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3 VL 4B Thinking Abliterated
Qwen · noctrex
Params4.02B
Context256K
Q4_K_M2.5 GB
LI
LightOnOCR 1B 1025
Lightonocr · noctrex
Params752M
Context8K
Q4_K_M0.5 GB
QW
Qwen3.5-35B-A3B
Qwen · noctrex
Params34.7B
Context256K
Smallest22.1 GB
DF
DFM Mimir
Dfm · noctrex
Params1.79B
Context4K
Smallest1.9 GB
QW
Huihui Qwen3 VL 8B Thinking Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3-Coder-Next
Qwen · noctrex
Params79.7B
Context256K
Smallest45.9 GB
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Huihui Qwen3 VL 4B Thinking Abliterated
Qwen · noctrex
Params4.02B
Context256K
Q4_K_M2.5 GB
PA
PaddleOCR VL 1.5
Paddleocr · noctrex
Params467M
Context128K
Smallest0.5 GB
GL
Glm-4.7-Flash
GLM · noctrex
Params29.9B
Context198K
Smallest17.3 GB
MI
Mistral Small 4 119B 2603
Mistral · noctrex
Params119B
Context1024K
Smallest67.7 GB
LL
Llama 3.3 8B Instruct 128k Abliterated
Llama · noctrex
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Coder REAP 25B A3B MXFP4 MOE
Qwen · noctrex
Params24.9B
Context256K
Smallest0.1 GB
LF
LFM2 24B A2B MXFP4 MOE
Lfm · noctrex
Params23.8B
Context125K
Smallest13.3 GB
PI
Pixtral 12b
Pixtral · noctrex
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3.5 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · noctrex
Params34.7B
Context256K
Smallest20.3 GB
QW
Qwopus3.6 27B v1 Preview
Qwopus · noctrex
Params3M
Context256K
Q4_K_M17.4 GB
LI
LightOnOCR 1B 1025
Lightonocr · noctrex
Params752M
Context8K
Q4_K_M0.5 GB
QW
Qwen3 42B A3B 2507 Thinking Abliterated uncen TOTAL RECALL v2 Medium MASTER CODER MXFP4 MOE
Qwen · noctrex
Params42.4B
Context256K
Smallest23.6 GB
CH
Chandra
Chandra · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.5-122B-A10B
Qwen · noctrex
Params122B
Context256K
Smallest74.0 GB
SE
SERA 32B
Sera · noctrex
Params32.8B
Context40K
Q4_K_M19.8 GB
OL
Olmo 3 7B Instruct Abliterated
OLMo · noctrex
Params7.3B
Context64K
Q4_K_M4.5 GB
LI
LightOnOCR 2 1B Bbox Soup
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
GL
GLM 4.7 Flash Claude Opus 4.5 High Reasoning Distill
GLM · noctrex
Params29.9B
Context198K
Smallest0.1 GB
QW
Qwen3 VL 30B A3B Thinking
Qwen · noctrex
Params30.5B
Context977K
Smallest17.1 GB
ZW
ZwZ 8B
Zwz · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
LF
Lfm2-8B-A1B
Lfm · noctrex
Params8.34B
Context125K
Smallest4.9 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · noctrex
Params79.7B
Context256K
Smallest43.7 GB
QW
Qwopus3.6 35B A3B v1
Qwopus · noctrex
Params34.7B
Context256K
Smallest20.3 GB