Orca GGUF models
161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.
OR
orca mini 3b
Orca · luxadev
Params3.43B
Context2K
Smallest2.0 GB
OR
orca 7b v0.1
Orca · areegtarek
Params7.24B
Context32K
Smallest14.5 GB
OR
orca 7b v0.1 8bit
Orca · areegtarek
Params7.24B
Context32K
Smallest7.7 GB
OR
Orca SOLAR 4x10.7b
Orca · macadeliccc
Params36.1B
Context4K
Q4_K_M21.8 GB
OR
orca mini 3b GGUF214
Orca · luxadev
Params3.43B
Context2K
Smallest3.6 GB
OR
Orca Nova 13B
Orca · actionpace
Params13B
Context4K
Smallest9.2 GB
OR
orca mini v7 72b i1
Orca · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
OR
L2 ORCA SFT 0
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
orca mini v9 6 1B Instruct
Orca · Nexesenex
Params1.24B
Context128K
Smallest1.3 GB
OR
ORCA1 EXP 0213
Orca · ORCA-AI
Params8.03B
Context8K
Smallest4.9 GB
OR
ORCA1 TURBO EXP 0214
Orca · ORCA-AI
Params8.03B
Context128K
Smallest4.9 GB