Orpheus GGUF models

187 GGUF models in the Orpheus family, quantized by 76 uploaders. Sizes run from 97M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
orpheus cy quantised
Orpheus · GarethEvs
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
OR
Orpheus Nano
Orpheus · mpasila
Params151M
Context8K
Smallest0.2 GB
GGUF
OR
orpheus web5ngay 4k q8 0
Orpheus · JohnyP
Params3.3B
Context128K
Smallest3.5 GB
Tool use
OR
Orpheus 3b Cantonese Daniethh
Orpheus · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
OR
orpheus_3b_Mongolia_v5
Orpheus · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
OR
Orpheus 3b 0.1 Ft
Orpheus · AJosh
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
OR
Orpheus 3b Q4_K_M
Orpheus · DeviantYC
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use

Keep browsing