Orion GGUF models
70 GGUF models in the Orion family, quantized by 19 uploaders. Sizes run from 1.79B to 25.2B parameters. The longest trained context is 256K tokens.
OR
Orion 14B Base
Orion · nold
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion 26B A4B v1f
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
OR
Orion HYMT1.5 7B SFT v2601
Orion · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
OR
Orion 14B LongChat
Orion · mradermacher
Params14.5B
Context195K
Q4_K_M8.8 GB
OR
Orion 14B Chat RAG
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion 26B A4B v1
Orion · Phil2Sat
Params25.2B
Context256K
Smallest13.4 GB
OR
Orion 14B Base Special
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion 26B A4B v1c
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
OR
Orion 14B Chat
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
JJ Orion 14B v1
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion 26B A4B v1
Orion · K4r14
Params25.2B
Context256K
Smallest18.5 GB
OR
Sosoai Orion 14B Chat RAG Safetensors
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
OR
Orion 26B A4B v1e
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
OR
Orion 14B Dacon Qa
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
L3.1 Orion a 8B
Orion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
OrionStarAI Orion 14B Chat Plugin
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
OR
Orion-14B-LongChat
Orion · mmnga
Params14.5B
Context195K
Q4_K_M8.8 GB
OR
Orion 26B A4B v1d
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
OR
L3.1 Orion b 8B
Orion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
OrionStarAI Orion 14B Chat RAG
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
OR
Orion-14B-Chat-RAG
Orion · mmnga
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
OrionStarAI Orion 14B Base
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
OR
Orion 14B Chata KoAlu2k
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion-14B-Chat
Orion · demonsu
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion v001
Orion · EdgeSkywalker
Params8.03B
Context128K
Smallest8.5 GB
OR
Orion 26B A4B v1b
Orion · Phil2Sat
Params25.2B
Context256K
Smallest13.9 GB
OR
Orion-14B-Chat
Orion · sosoai
Params14.5B
Context4K
Q4_K_M8.8 GB
OR
Orion HYMT1.5 1.8B SFT v2601
Orion · shoutmon
Params1.79B
Context256K
Smallest1.9 GB
OR
Orion-14B-Chat-0126-ck19800
Orion · izumi04
Params14.5B
Context4K
Smallest8.3 GB
OR
Orion-2B
Orion · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB