GGUF models by noctrex

173 GGUF models quantized by noctrex on Hugging Face. Sizes run from 1M to 396B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 235B A22B Instruct
Qwen · noctrex
Params235B
Context1024K
Smallest129.3 GB
Tool useVision
LI
LightOnOCR 2 1B Bbox
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen3 VL 30B A3B Instruct
Qwen · noctrex
Params30.5B
Context977K
Smallest17.1 GB
Tool useVision
LF
LFM2.5 8B A1B MXFP4 MOE
Lfm · noctrex
Params8.47B
Context125K
Smallest5.1 GB
ReasoningTool use
RN
Rnj 1 Instruct
Rnj · noctrex
Params8.31B
Context32K
Q4_K_M5.1 GB
Tool use
QW
Qwen3 VL 235B A22B Thinking 1M
Qwen · noctrex
Params235B
Context1024K
Smallest129.3 GB
ReasoningTool useVision
ZW
ZwZ 4B
Zwz · noctrex
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool useVision
GE
Gelato 30B A3B
Gelato · noctrex
Params30.5B
Context256K
Smallest17.1 GB
Tool useVision
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
GGUF
SM
SmallThinker 4B A0.6B Instruct MXFP4 MOE
Smallthinker · noctrex
Params4.27B
Context32K
Smallest0.0 GB
GGUF
GE
GELab Zero 4B Preview
Gelab · noctrex
Params4.02B
Context256K
Smallest4.3 GB
Tool useVision
HU
Huihui MoE 60B A3B abliterated MXFP4 MOE
Huihui · noctrex
Params59.5B
Context256K
Smallest32.5 GB
ReasoningTool use
LA
Laguna XS 2.1 MXFP4 MOE
Laguna · noctrex
Params33.4B
Context256K
Smallest19.2 GB
ReasoningTool use
OP
OpenThinker Agent v1 Abliterated
Openthinker · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
VE
UI Venus 1.5 30B A3B
Venus · noctrex
Params30.5B
Context256K
Smallest17.1 GB
Tool useVision
JA
Jan v2 VL Low
Jan · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
KI
Kimi Linear 48B A3B Instruct
Kimi · noctrex
Params49.1B
Context1024K
Smallest29.0 GB
Tool use
QW
Qwen3 Next 80B A3B Instruct
Qwen · noctrex
Params79.7B
Context256K
Smallest43.7 GB
Tool use
NE
Nemotron 3 Nano 30B A3B MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningTool use
HU
Huihui Ling Mini 2.0 Abliterated
Huihui · noctrex
Params16.3B
Context32K
Q4_K_M9.9 GB
ReasoningTool use
DE
Deepseek Moe 16b Chat
DeepSeek · noctrex
Params16.4B
Context4K
Smallest9.5 GB
GGUF
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · noctrex
Params48.9B
Context256K
Smallest27.3 GB
CodingTool use
HU
Huihui Orchestrator 8B Abliterated
Huihui · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
Granite-4.0-H-Tiny
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
Tool use
KI
Kimi VL A3B Thinking 2506
Kimi · noctrex
Params16B
Context128K
Smallest9.3 GB
ReasoningVision
NE
Nemotron Cascade 2 30B A3B
Nemotron · noctrex
Params31.6B
Context1024K
Smallest20.0 GB
ReasoningTool use
QU
QUEST 35B RL
Quest · noctrex
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool use
QW
Qwopus3.6 35B A3B v1
Qwopus · noctrex
Params35.5B
Context256K
Smallest21.2 GB
GGUF
MO
Moonlight 16B A3B Instruct
Moonlight · noctrex
Params16B
Context8K
Smallest9.3 GB
GGUF
LF
LFM2 VL 1.6B
Lfm · noctrex
Params1.17B
Context125K
Smallest1.2 GB
Vision

Keep browsing