GGUF models by noctrex
173 GGUF models quantized by noctrex on Hugging Face. Sizes run from 1M to 396B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 Coder REAP 246B A35B MXFP4 MOE
Qwen · noctrex
Params246B
Context256K
Smallest137.2 GB
QW
Qwen3 Coder Next REAM
Qwen · noctrex
Params60.3B
Context256K
Smallest35.6 GB
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · noctrex
Params30.5B
Context256K
Smallest17.1 GB
PR
Pristine 8B A1B MXFP4 MOE
Pristine · noctrex
Params8.34B
Context125K
Smallest0.0 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · noctrex
Params30.5B
Context256K
Smallest17.1 GB
DO
Dolphin Xgen RL
Dolphin · noctrex
Params10.7B
Context256K
Q4_K_M6.5 GB
OP
openPangu Embedded 7B DeepDiver
Openpangu · noctrex
Params8.03B
Context144K
Q4_K_M4.9 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.3 GB
GL
GLM 4.5 Air Derestricted
GLM · noctrex
Params110B
Context128K
Smallest63.3 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · noctrex
Params108B
Context10240K
Smallest63.2 GB
HU
Huihui LFM2 8B A1B Abliterated
Huihui · noctrex
Params8.34B
Context125K
Smallest5.3 GB
QW
Qwen3 30B A3B CoderThinking YOYO Linear
Qwen · noctrex
Params30.5B
Context256K
Smallest17.1 GB
GL
Glm-4.6V
GLM · noctrex
Params107B
Context128K
Smallest60.7 GB
LF
LFM2 VL 3B
Lfm · noctrex
Params2.57B
Context125K
Smallest2.7 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · noctrex
Params3.19B
Context1024K
Smallest3.4 GB
QW
Qwen3 Next 80B A3B Thinking
Qwen · noctrex
Params79.7B
Context256K
Smallest43.7 GB
LI
Ling 3.0 flash heretic MXFP4 MOE
Ling · noctrex
Params127B
Context256K
Smallest70.8 GB
KA
KAT Coder V2.5 Dev
Kat · noctrex
Params35.5B
Context256K
Smallest20.4 GB
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · noctrex
Params18.4B
Context128K
Smallest10.6 GB
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
SE
SERA 8B
Sera · noctrex
Params8.19B
Context40K
Q4_K_M5.0 GB
LI
Ling Mini 2.0
Ling · noctrex
Params16.3B
Context32K
Smallest9.2 GB
ER
Ernie-4.5-21B-A3B-Pt
Ernie · noctrex
Params21.8B
Context128K
Smallest12.4 GB
OL
OLMoE 1B 7B 0125 Instruct MXFP4 MOE
OLMo · noctrex
Params6.92B
Context4K
Smallest3.9 GB
HU
Huihui MoE 4.8B A1.7B abliterated MXFP4 MOE
Huihui · noctrex
Params4.89B
Context40K
Smallest3.0 GB
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
TH
The Philosopher Zephyr 7B
The · noctrex
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
Huihui MoE 12B A4B Abliterated
Huihui · noctrex
Params12.5B
Context40K
Smallest7.6 GB
TO
Tongyi DeepResearch 30B A3B
Tongyi · noctrex
Params30.5B
Context128K
Smallest17.1 GB
IN
InternVL3_5 30B A3B
Internvl · noctrex
Params30.5B
Context40K
Smallest17.1 GB