GGUF models by mudler

92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LO
locate anything.cpp
Locateanything · mudler
Params3.83B
Context—
Smallest4.7 GB
GGUF
LA
Laguna XS 2.1 APEX
Laguna · mudler
Params33.4B
Context256K
Smallest12.8 GB
Coding
KA
KAT Coder V2.5 Dev APEX
Kat · mudler
Params34.7B
Context256K
Smallest13.5 GB
Coding
OR
Ornith 1.5 35B A3B APEX MTP
Ornith · mudler
Params447M
Context256K
Smallest14.4 GB
Vision
OR
Ornith 1.5 35B A3B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
CodingVision
QW
Qwen3.6-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
ReasoningVision
FA
face detect
Face · mudler
Params70M
Context—
Smallest0.0 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
Vision
VI
vibevoice.cpp models
Vibevoice · mudler
Params—
Context—
Smallest0.0 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning APEX
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningVision
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
Vision
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
GGUF
AG
Agents A1 APEX
Agents · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
QW
Qwen3.8 27B APEX
Qwen · mudler
Params27.3B
Context256K
Smallest11.2 GB
Vision
QW
Qwen3.6 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
VO
voice detect
Voice · mudler
Params318M
Context—
Smallest0.0 GB
GGUF
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 35B A3B Uncensored FernflowerAI APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning
QW
Carnice Qwen3.6 MoE 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
QW
Qwopus3.6 35B A3B Coder APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
CodingVision
QW
Carnice Qwen3.6 MoE 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
QW
Qwen3-Coder-Next
Qwen · mudler
Params79.7B
Context256K
Smallest31.4 GB
Coding
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
MI
Mistral-Small-4-119B-2603
Mistral · mudler
Params119B
Context1024K
Smallest52.9 GB
Vision

About mudler on Hugging Face

mudler has published 92 GGUF models that ggufmodels.com tracks, across families such as Qwen, Rfdetr and Minerva. The most downloaded are locate anything.cpp, Laguna XS 2.1 APEX and KAT Coder V2.5 Dev APEX.

The quants mudler publishes most often are F16 (33), Q8_0 (20), Q4_K (16) and F32 (15). Their Q4_K_M files range from 1.8 to 8.6 GB. Parameter counts run from 30M to 397B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has mudler published?

92 models are listed here, mainly from the Qwen, Rfdetr and Minerva families. The most downloaded is locate anything.cpp.

Which quants does mudler publish?

The most common are F16 (33 models), Q8_0 (20 models), Q4_K (16 models) and F32 (15 models).

Keep browsing