GGUF models by mudler

92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 35B A3B Claude Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
GE
Gemopus 4 26B A4B it Preview APEX
Gemopus · mudler
Params25.2B
Context256K
Smallest13.0 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · mudler
Params122B
Context256K
Smallest48.3 GB
Vision
QW
Qwen3 Coder 30B APEX
Qwen · mudler
Params30.5B
Context256K
Smallest12.1 GB
Coding
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
GGUF
HO
Holo3 35B A3B APEX
Holo · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
QW
Qwopus3.6 35B A3B Coder APEX MTP
Qwopus · mudler
Params447M
Context256K
Smallest14.3 GB
CodingVision
LF
LFM2.5 8B A1B APEX
Lfm · mudler
Params8.47B
Context125K
Smallest3.6 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B APEX
Nemotron · mudler
Params121B
Context—
Smallest8.9 GB
GGUF
GL
Glm-4.7-Flash
GLM · mudler
Params29.9B
Context198K
Smallest11.9 GB
GGUF
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
GGUF
CA
Carnice MoE 35B A3B APEX
Carnice · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
GGUF
DA
Darwin 36B Opus APEX
Darwin · mudler
Params34.7B
Context256K
Smallest11.5 GB
Reasoning
FL
flint APEX
Flint · mudler
Params39.8B
Context256K
Smallest14.8 GB
ReasoningTool use
QW
Qwopus3.6 35B A3B v1 APEX MTP
Qwopus · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
QW
Qwen3.5-397B-A17B
Qwen · mudler
Params397B
Context256K
Smallest186.9 GB
Vision
NE
Nex N2 mini APEX
Nex · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
QW
Qwopus MoE 35B A3B APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest14.3 GB
GGUF
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
GGUF
MI
Minimax-M2.5
Minimax · mudler
Params229B
Context192K
Smallest85.9 GB
GGUF
MO
moss transcribe.cpp
Moss · mudler
Params909M
Context—
Smallest0.5 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest17.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · mudler
Params177B
Context256K
Smallest73.0 GB
GGUF
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
GGUF
QW
Qwopus3.6 35B A3B v1 APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
Reasoning
ST
Step-3.7
Step · mudler
Params197B
Context256K
Smallest72.9 GB
Vision
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
GGUF
LF
LFM2 24B A2B APEX
Lfm · mudler
Params23.8B
Context125K
Smallest9.5 GB
GGUF

Keep browsing