Audio GGUF models
1518 GGUF models: speech, music and audio models, which are not language models. Sizes run from 1M to 35.9B parameters. The longest trained context is 1024K tokens.
MU
MuScriptor Small
Muscriptor · DamRsn
Params1.37B
Context—
Smallest0.2 GB
GR
Granite Speech 4.1 2B
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
FU
Fun ASR MLT Nano 2512
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
CO
Confucius4 R2T2 Q4 K M
Confucius · Nairod785
Params—
Context—
Q4_K_M1.2 GB
AU
Audio8-TTS-Preview-0.6b
Audio · js-byte
Params1.3B
Context—
Smallest1.4 GB
SE
SenseVoiceSmall GGUF audiocpp
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
DR
drama-3
Drama · pentacoxian-dev
Params—
Context—
Smallest10.5 GB
VI
VieNeu-TTS-v3-Turbo
Vieneu · phuocnguyen90
Params146M
Context—
Smallest0.2 GB
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
PA
orukeet-gabor-half.q8_0
Parakeet · oruk
Params627M
Context—
Smallest0.7 GB
CA
Canary 1B Flash
Canary · handy-computer
Params890M
Context—
Q4_K_M0.7 GB
US
RE USE
Use · audio-cpp
Params10M
Context—
Smallest0.0 GB
DI
diar streaming sortformer 4spk v2
Diar · nvidia
Params123M
Context—
Smallest0.1 GB
PA
parakeet primeline
Parakeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
GI
GigaAM v3 E2E-CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
DR
drama-3
Drama · sakasegawa
Params35.8B
Context—
Smallest20.8 GB
BR
Breeze-ASR-25
Breeze · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
MI
Voxtral Mini 3B
Mistral · handy-computer
Params4.7B
Context—
Q4_K_M3.0 GB
QW
Canary-Qwen 2.5B
Qwen · handy-computer
Params2.53B
Context—
Q4_K_M1.7 GB
PA
Parakeet TDT 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
SE
SenseVoice Small
Sensevoicesmall · handy-computer
Params234M
Context—
Q4_K_M0.1 GB
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
MI
Ming 3.0 Audio Tiny
Ming · audio-cpp
Params—
Context—
Smallest10.0 GB
FU
Fun-ASR Nano
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
QW
qwen3-tts-tokenizer-12hz
Qwen · cstr
Params162M
Context—
Smallest0.3 GB
BR
breeze-tts-2
Breeze · cstr
Params2.85B
Context—
Smallest2.2 GB
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB