GGUF models by noctrex

173 GGUF models quantized by noctrex on Hugging Face. Sizes run from 1M to 396B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder REAP 246B A35B MXFP4 MOE
Qwen · noctrex
Params246B
Context256K
Smallest137.2 GB
CodingTool use
QW
Qwen3 Coder Next REAM
Qwen · noctrex
Params60.3B
Context256K
Smallest35.6 GB
CodingTool use
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · noctrex
Params30.5B
Context256K
Smallest17.1 GB
ReasoningTool use
PR
Pristine 8B A1B MXFP4 MOE
Pristine · noctrex
Params8.34B
Context125K
Smallest0.0 GB
GGUF
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · noctrex
Params30.5B
Context256K
Smallest17.1 GB
CodingTool useVision
DO
Dolphin Xgen RL
Dolphin · noctrex
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
OP
openPangu Embedded 7B DeepDiver
Openpangu · noctrex
Params8.03B
Context144K
Q4_K_M4.9 GB
Embedding
NE
Nemotron 3 Nano Omni 30B A3B Reasoning MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.3 GB
ReasoningTool useVision
GL
GLM 4.5 Air Derestricted
GLM · noctrex
Params110B
Context128K
Smallest63.3 GB
ReasoningTool use
LL
Llama-4-Scout-17B-16E-Instruct
Llama · noctrex
Params108B
Context10240K
Smallest63.2 GB
Tool use
HU
Huihui LFM2 8B A1B Abliterated
Huihui · noctrex
Params8.34B
Context125K
Smallest5.3 GB
Tool use
QW
Qwen3 30B A3B CoderThinking YOYO Linear
Qwen · noctrex
Params30.5B
Context256K
Smallest17.1 GB
CodingReasoningTool use
GL
Glm-4.6V
GLM · noctrex
Params107B
Context128K
Smallest60.7 GB
ReasoningTool useVision
LF
LFM2 VL 3B
Lfm · noctrex
Params2.57B
Context125K
Smallest2.7 GB
Vision
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · noctrex
Params3.19B
Context1024K
Smallest3.4 GB
Tool use
QW
Qwen3 Next 80B A3B Thinking
Qwen · noctrex
Params79.7B
Context256K
Smallest43.7 GB
ReasoningTool use
LI
Ling 3.0 flash heretic MXFP4 MOE
Ling · noctrex
Params127B
Context256K
Smallest70.8 GB
ReasoningTool use
KA
KAT Coder V2.5 Dev
Kat · noctrex
Params35.5B
Context256K
Smallest20.4 GB
GGUF
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · noctrex
Params18.4B
Context128K
Smallest10.6 GB
Tool use
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
SE
SERA 8B
Sera · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LI
Ling Mini 2.0
Ling · noctrex
Params16.3B
Context32K
Smallest9.2 GB
ReasoningTool use
ER
Ernie-4.5-21B-A3B-Pt
Ernie · noctrex
Params21.8B
Context128K
Smallest12.4 GB
GGUF
OL
OLMoE 1B 7B 0125 Instruct MXFP4 MOE
OLMo · noctrex
Params6.92B
Context4K
Smallest3.9 GB
GGUF
HU
Huihui MoE 4.8B A1.7B abliterated MXFP4 MOE
Huihui · noctrex
Params4.89B
Context40K
Smallest3.0 GB
GGUF
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
Tool use
TH
The Philosopher Zephyr 7B
The · noctrex
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HU
Huihui MoE 12B A4B Abliterated
Huihui · noctrex
Params12.5B
Context40K
Smallest7.6 GB
ReasoningTool use
TO
Tongyi DeepResearch 30B A3B
Tongyi · noctrex
Params30.5B
Context128K
Smallest17.1 GB
ReasoningTool use
IN
InternVL3_5 30B A3B
Internvl · noctrex
Params30.5B
Context40K
Smallest17.1 GB
Vision

Keep browsing