GGUF models by noctrex
173 GGUF models quantized by noctrex on Hugging Face. Sizes run from 1M to 396B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 VL 235B A22B Instruct
Qwen · noctrex
Params235B
Context1024K
Smallest129.3 GB
LI
LightOnOCR 2 1B Bbox
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · noctrex
Params30.5B
Context977K
Smallest17.1 GB
LF
LFM2.5 8B A1B MXFP4 MOE
Lfm · noctrex
Params8.47B
Context125K
Smallest5.1 GB
RN
Rnj 1 Instruct
Rnj · noctrex
Params8.31B
Context32K
Q4_K_M5.1 GB
QW
Qwen3 VL 235B A22B Thinking 1M
Qwen · noctrex
Params235B
Context1024K
Smallest129.3 GB
ZW
ZwZ 4B
Zwz · noctrex
Params4.41B
Context256K
Q4_K_M2.7 GB
GE
Gelato 30B A3B
Gelato · noctrex
Params30.5B
Context256K
Smallest17.1 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
SM
SmallThinker 4B A0.6B Instruct MXFP4 MOE
Smallthinker · noctrex
Params4.27B
Context32K
Smallest0.0 GB
GE
GELab Zero 4B Preview
Gelab · noctrex
Params4.02B
Context256K
Smallest4.3 GB
HU
Huihui MoE 60B A3B abliterated MXFP4 MOE
Huihui · noctrex
Params59.5B
Context256K
Smallest32.5 GB
LA
Laguna XS 2.1 MXFP4 MOE
Laguna · noctrex
Params33.4B
Context256K
Smallest19.2 GB
OP
OpenThinker Agent v1 Abliterated
Openthinker · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
VE
UI Venus 1.5 30B A3B
Venus · noctrex
Params30.5B
Context256K
Smallest17.1 GB
JA
Jan v2 VL Low
Jan · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · noctrex
Params49.1B
Context1024K
Smallest29.0 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · noctrex
Params79.7B
Context256K
Smallest43.7 GB
NE
Nemotron 3 Nano 30B A3B MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.0 GB
HU
Huihui Ling Mini 2.0 Abliterated
Huihui · noctrex
Params16.3B
Context32K
Q4_K_M9.9 GB
DE
Deepseek Moe 16b Chat
DeepSeek · noctrex
Params16.4B
Context4K
Smallest9.5 GB
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · noctrex
Params48.9B
Context256K
Smallest27.3 GB
HU
Huihui Orchestrator 8B Abliterated
Huihui · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
Granite-4.0-H-Tiny
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
KI
Kimi VL A3B Thinking 2506
Kimi · noctrex
Params16B
Context128K
Smallest9.3 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · noctrex
Params31.6B
Context1024K
Smallest20.0 GB
QU
QUEST 35B RL
Quest · noctrex
Params34.7B
Context256K
Smallest19.8 GB
QW
Qwopus3.6 35B A3B v1
Qwopus · noctrex
Params35.5B
Context256K
Smallest21.2 GB
MO
Moonlight 16B A3B Instruct
Moonlight · noctrex
Params16B
Context8K
Smallest9.3 GB
LF
LFM2 VL 1.6B
Lfm · noctrex
Params1.17B
Context125K
Smallest1.2 GB