GGUF models by mudler
92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.
QW
Qwen3.5 35B A3B Claude Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
GE
Gemopus 4 26B A4B it Preview APEX
Gemopus · mudler
Params25.2B
Context256K
Smallest13.0 GB
QW
Qwen3.5-122B-A10B
Qwen · mudler
Params122B
Context256K
Smallest48.3 GB
QW
Qwen3 Coder 30B APEX
Qwen · mudler
Params30.5B
Context256K
Smallest12.1 GB
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
HO
Holo3 35B A3B APEX
Holo · mudler
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwopus3.6 35B A3B Coder APEX MTP
Qwopus · mudler
Params447M
Context256K
Smallest14.3 GB
LF
LFM2.5 8B A1B APEX
Lfm · mudler
Params8.47B
Context125K
Smallest3.6 GB
NE
NVIDIA Nemotron 3 Super 120B A12B APEX
Nemotron · mudler
Params121B
Context—
Smallest8.9 GB
GL
Glm-4.7-Flash
GLM · mudler
Params29.9B
Context198K
Smallest11.9 GB
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
CA
Carnice MoE 35B A3B APEX
Carnice · mudler
Params34.7B
Context256K
Smallest14.3 GB
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
DA
Darwin 36B Opus APEX
Darwin · mudler
Params34.7B
Context256K
Smallest11.5 GB
FL
flint APEX
Flint · mudler
Params39.8B
Context256K
Smallest14.8 GB
QW
Qwopus3.6 35B A3B v1 APEX MTP
Qwopus · mudler
Params35.5B
Context256K
Smallest11.7 GB
QW
Qwen3.5-397B-A17B
Qwen · mudler
Params397B
Context256K
Smallest186.9 GB
NE
Nex N2 mini APEX
Nex · mudler
Params34.7B
Context256K
Smallest13.5 GB
QW
Qwopus MoE 35B A3B APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest14.3 GB
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
MI
Minimax-M2.5
Minimax · mudler
Params229B
Context192K
Smallest85.9 GB
MO
moss transcribe.cpp
Moss · mudler
Params909M
Context—
Smallest0.5 GB
QW
Qwen3.5-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest17.0 GB
QW
Qwen3.8 Flash Next
Qwen · mudler
Params177B
Context256K
Smallest73.0 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
QW
Qwopus3.6 35B A3B v1 APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
ST
Step-3.7
Step · mudler
Params197B
Context256K
Smallest72.9 GB
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
LF
LFM2 24B A2B APEX
Lfm · mudler
Params23.8B
Context125K
Smallest9.5 GB