Audio GGUF models

1518 GGUF models: speech, music and audio models, which are not language models. Sizes run from 1M to 35.9B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YU
YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong
Yue · Serveurperso
Params632M
Context—
Smallest0.0 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · handy-computer
Params638M
Context—
Q4_K_M0.5 GB
GGUF
MO
MOSS Music 8B Instruct
Moss · scragnog
Params8.2B
Context—
Smallest1.7 GB
GGUF
VI
VieNeu-TTS-v3-Turbo-staging
Vieneu · pnnbao-ump
Params146M
Context—
Smallest0.2 GB
GGUF
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
GGUF
NE
nemotron-3.5-asr-streaming-0.6b.q8_0
Nemotron · nvidia
Params648M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
GGUF
HI
Higgs Audio v3 Studio
Higgs · drbaph
Params4.65B
Context—
Q4_K_M4.1 GB
GGUF
QW
Qwen3-TTS-Tokenizer-12Hz
Qwen · Serveurperso
Params1.9B
Context—
Q4_K_M0.3 GB
GGUF
WH
Whisper Medium
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
GGUF
MI
MiniMax-Music
Minimax · audio-cpp
Params4.9B
Context—
Smallest0.1 GB
GGUF
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · nvidia
Params637M
Context—
Smallest0.7 GB
GGUF
WH
Whisper Large v3 Turbo
Whisper · handy-computer
Params809M
Context—
Q4_K_M0.5 GB
GGUF
MI
Voxtral Mini 4B Realtime
Mistral · handy-computer
Params4.43B
Context—
Q4_K_M2.8 GB
GGUF
WH
Whisper Large v3
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
DR
drama-3
Drama · Jmica
Params—
Context—
Smallest17.1 GB
GGUF
BR
Breeze-TTS-2
Breeze · HoppouAI
Params3.01B
Context—
Smallest2.5 GB
GGUF
CA
Canary 180M Flash
Canary · handy-computer
Params189M
Context—
Q4_K_M0.1 GB
GGUF
QW
Qwen3-ASR 1.7B
Qwen · handy-computer
Params2.04B
Context—
Q4_K_M1.3 GB
GGUF
SA
SAM Audio
Sam · audio-cpp
Params—
Context—
Smallest2.4 GB
GGUF
YU
Yue2-3B-GGUF
Yue · audio-cpp
Params3.63B
Context—
Smallest0.3 GB
GGUF
AR
ark asr 3b
Ark · cstr
Params3.75B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3-ASR 0.6B
Qwen · handy-computer
Params782M
Context—
Q4_K_M0.6 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
AC
audio.cpp
Acestep · CaptainArni
Params—
Context—
Smallest10.7 GB
GGUF
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
GGUF
AU
Audio Flamingo
Audio · audio-cpp
Params—
Context—
Smallest5.5 GB
GGUF
NE
Nemotron-3-Diarization.q8_0
Nemotron · nvidia
Params99M
Context—
Smallest0.1 GB
GGUF
IN
index-echo-s2tt-gsgs1hiv
Index · audio-cpp
Params—
Context—
Smallest2.3 GB
GGUF

About Audio GGUF models

1,518 GGUF models are filed under Audio: speech, music and audio models, which are not language models. The most downloaded are YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong, Parakeet Unified EN 0.6B and nemotron 3.5 asr streaming 0.6b. Parameter counts run from 1M to 35.9B, and the longest trained context window is 1024K tokens.

These are speech, music or audio models, not language models, and they need a runtime built for them. The memory estimates on this site are rough for them. The families you will see most are Qwen (168), Parakeet (153) and Whisper (121).

Frequently asked questions

What are Audio GGUF models?

Speech, music and audio models, which are not language models. There are 1,518 of them on this site.

Which Audio GGUF model should I start with?

The most downloaded is YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong. Choose the size that fits your GPU, then a Q4_K_M quant unless you have memory to spare.

Other uses

Keep browsing