Orion GGUF models
70 GGUF models in the Orion family, quantized by 19 uploaders. Sizes run from 1.79B to 25.2B parameters. The longest trained context is 256K tokens.
OR
orion 14b longchat
Orion · demonsu
Params14B
Context—
Q4_K_M4.6 GB
OR
orion 14b longchat
Orion · ij5
Params14.5B
Context4K
Smallest8.3 GB
OR
Orion-14B-Base
Orion · demonsu
Params14.5B
Context4K
Smallest11.9 GB
OR
Orion-14B-Chat-RAG
Orion · demonsu
Params14.5B
Context4K
Smallest11.9 GB
OR
Orion-14B-Chat-Plugin
Orion · demonsu
Params14.5B
Context4K
Smallest15.4 GB
OR
Orion 14B LongChat Q5 K S
Orion · ywhwang
Params14.5B
Context195K
Smallest10.0 GB
OR
Orion 14B Chat
Orion · condblock
Params14.5B
Context4K
Smallest10.3 GB
OR
Orion HYMT1.5 7B SFT v2601
Orion · shoutmon
Params7.5B
Context256K
Smallest8.0 GB
OR
orion ai engine
Orion · matebricks
Params3.47B
Context—
Smallest4.1 GB
OR
orion ai model
Orion · matebricks
Params3.21B
Context128K
Q4_K_M2.0 GB