Orion GGUF models

70 GGUF models in the Orion family, quantized by 19 uploaders. Sizes run from 1.79B to 25.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
orion 14b longchat
Orion · demonsu
Params14B
Context—
Q4_K_M4.6 GB
GGUF
OR
orion 14b longchat
Orion · ij5
Params14.5B
Context4K
Smallest8.3 GB
GGUF
OR
Orion-14B-Base
Orion · demonsu
Params14.5B
Context4K
Smallest11.9 GB
GGUF
OR
Orion-14B-Chat-RAG
Orion · demonsu
Params14.5B
Context4K
Smallest11.9 GB
GGUF
OR
Orion-14B-Chat-Plugin
Orion · demonsu
Params14.5B
Context4K
Smallest15.4 GB
GGUF
OR
Orion 14B LongChat Q5 K S
Orion · ywhwang
Params14.5B
Context195K
Smallest10.0 GB
GGUF
OR
Orion 14B Chat
Orion · condblock
Params14.5B
Context4K
Smallest10.3 GB
Coding
OR
Orion HYMT1.5 7B SFT v2601
Orion · shoutmon
Params7.5B
Context256K
Smallest8.0 GB
GGUF
OR
orion ai engine
Orion · matebricks
Params3.47B
Context—
Smallest4.1 GB
GGUF
OR
orion ai model
Orion · matebricks
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing