Orion GGUF models

70 GGUF models in the Orion family, quantized by 19 uploaders. Sizes run from 1.79B to 25.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
Orion 14B Base
Orion · nold
Params14.5B
Context4K
Q4_K_M8.8 GB
Coding
OR
Orion 26B A4B v1f
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
OR
Orion HYMT1.5 7B SFT v2601
Orion · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
OR
Orion 14B LongChat
Orion · mradermacher
Params14.5B
Context195K
Q4_K_M8.8 GB
Coding
OR
Orion 14B Chat RAG
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
Coding
OR
Orion 26B A4B v1
Orion · Phil2Sat
Params25.2B
Context256K
Smallest13.4 GB
ReasoningTool use
OR
Orion 14B Base Special
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
Orion 26B A4B v1c
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
OR
Orion 14B Chat
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
Coding
OR
JJ Orion 14B v1
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
Orion 26B A4B v1
Orion · K4r14
Params25.2B
Context256K
Smallest18.5 GB
ReasoningTool use
OR
Sosoai Orion 14B Chat RAG Safetensors
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
OR
Orion 26B A4B v1e
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
OR
Orion 14B Dacon Qa
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
L3.1 Orion a 8B
Orion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
OrionStarAI Orion 14B Chat Plugin
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
OR
Orion-14B-LongChat
Orion · mmnga
Params14.5B
Context195K
Q4_K_M8.8 GB
GGUF
OR
Orion 26B A4B v1d
Orion · BeaverAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
OR
L3.1 Orion b 8B
Orion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
OrionStarAI Orion 14B Chat RAG
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
OR
Orion-14B-Chat-RAG
Orion · mmnga
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
OrionStarAI Orion 14B Base
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
OR
Orion 14B Chata KoAlu2k
Orion · mradermacher
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
Orion-14B-Chat
Orion · demonsu
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
Orion v001
Orion · EdgeSkywalker
Params8.03B
Context128K
Smallest8.5 GB
GGUF
OR
Orion 26B A4B v1b
Orion · Phil2Sat
Params25.2B
Context256K
Smallest13.9 GB
ReasoningTool use
OR
Orion-14B-Chat
Orion · sosoai
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
OR
Orion HYMT1.5 1.8B SFT v2601
Orion · shoutmon
Params1.79B
Context256K
Smallest1.9 GB
GGUF
OR
Orion-14B-Chat-0126-ck19800
Orion · izumi04
Params14.5B
Context4K
Smallest8.3 GB
GGUF
OR
Orion-2B
Orion · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing