Orpheus GGUF models
187 GGUF models in the Orpheus family, quantized by 76 uploaders. Sizes run from 97M to 8.03B parameters. The longest trained context is 128K tokens.
OR
orpheus cy quantised
Orpheus · GarethEvs
Params3.3B
Context128K
Q4_K_M2.1 GB
OR
Orpheus Nano
Orpheus · mpasila
Params151M
Context8K
Smallest0.2 GB
OR
orpheus web5ngay 4k q8 0
Orpheus · JohnyP
Params3.3B
Context128K
Smallest3.5 GB
OR
Orpheus 3b Cantonese Daniethh
Orpheus · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
OR
orpheus_3b_Mongolia_v5
Orpheus · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
OR
Orpheus 3b 0.1 Ft
Orpheus · AJosh
Params3.3B
Context128K
Q4_K_M2.1 GB
OR
Orpheus 3b Q4_K_M
Orpheus · DeviantYC
Params3.3B
Context128K
Q4_K_M2.1 GB