Muse GGUF models

215 GGUF models in the Muse family, quantized by 110 uploaders. Sizes run from 105M to 820B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MU
Muse Glimmer 30B
Muse · unsloth
Params27.9B
Context128K
Smallest1.6 GB
Vision
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
Vision
MU
Muse Glimmer 30B
Muse · lmstudio-community
Params28B
Context128K
Q4_K_M16.8 GB
Vision
MU
Homura 30B
Muse · hyrelabs
Params28B
Context128K
Q4_K_M16.9 GB
Tool use
MU
Muse Glimmer 30B
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
MU
Muse Glimmer 30B Heretic Uncensored
Muse · 0bserverx
Params28B
Context128K
Q4_K_M16.9 GB
Vision
MU
Muse-Glimmer-30B
Muse · AtomicChat
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool useVision
MU
Muse-Glimmer-30B
Muse · weareapexcreators
Params28B
Context128K
Smallest12.4 GB
GGUF
MU
Muse Glimmer 30B Abliterated
Muse · The-freezer
Params28B
Context128K
Q4_K_M1.6 GB
Vision
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
GGUF
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
MU
Muse-Glimmer-30B
Muse · ggml-org
Params27.9B
Context128K
Q4_K_M19.2 GB
ReasoningTool useVision
MU
Muse Glimmer 30B
Muse · AaryanK
Params28B
Context128K
Q4_K_M15.9 GB
Vision
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
CodingReasoningVision
MU
Muse-Glimmer-30B-Hermes-Agentic
Muse · vcruz305
Params27.9B
Context128K
Q4_K_M16.9 GB
Tool useVision
MU
Muse Glimmer 30B uncensored
Muse · TrevorJS
Params28B
Context128K
Q4_K_M16.9 GB
Vision
MU
Muse Glimmer 30B pruned V2.5 en pl
Muse · bluevoid-pl
Params27B
Context128K
Q4_K_M16.3 GB
ReasoningTool useVision
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool use
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
GGUF
MU
Muse Glimmer 30B NVFP4
Muse · esatapedico
Params27.9B
Context128K
Smallest15.2 GB
Vision
MU
Muse Glimmer 30B CRACK Fp16
Muse · dealignai
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool useVision
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
GGUF
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
GGUF
MU
Muse Glimmer 30B ROCmFP4 Strix Halo DFlash
Muse · kingjones777
Params28B
Context128K
Smallest1.5 GB
ReasoningTool useVision
MU
Muse 12B
Muse · LatitudeGames
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MU
Muse Glimmer 30B Uncensored Heretic
Muse · OS-Software
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
MU
Muse Glimmer 30B Uncensored
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
MU
Muse Glimmer 30B Heretic R2
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision

About the Muse GGUF models

Muse is represented on ggufmodels.com by 215 GGUF models, quantized by 110 uploaders on Hugging Face. The most downloaded are Muse Glimmer 30B, Muse Glimmer 30B and Muse Glimmer 30B. Parameter counts run from 105M to 820B, and the longest trained context window is 1024K tokens.

A Q4_K_M file of a Muse model is between 0.4 to 499.6 GB, which is the quant most people start with. Most files come from mradermacher (59), MCult01 (13) and mlasli (7). The quants you will meet most often are Q4_K_M (144), Q5_K_M (101), Q8_0 (92) and Q6_K (92), where the number is how many models offer that quant.

Frequently asked questions

Which Muse GGUF should I download?

The most downloaded Muse GGUF here is Muse Glimmer 30B. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Muse model need?

Q4_K_M files of Muse models on this site range from 0.4 to 499.6 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Muse GGUF files come from?

The most common quantizers here are mradermacher, MCult01 and mlasli. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing