Orca GGUF models

161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
orca mini 3b
Orca · luxadev
Params3.43B
Context2K
Smallest2.0 GB
GGUF
OR
orca 7b v0.1
Orca · areegtarek
Params7.24B
Context32K
Smallest14.5 GB
GGUF
OR
orca 7b v0.1 8bit
Orca · areegtarek
Params7.24B
Context32K
Smallest7.7 GB
GGUF
OR
Orca SOLAR 4x10.7b
Orca · macadeliccc
Params36.1B
Context4K
Q4_K_M21.8 GB
GGUF
OR
orca mini 3b GGUF214
Orca · luxadev
Params3.43B
Context2K
Smallest3.6 GB
GGUF
OR
Orca Nova 13B
Orca · actionpace
Params13B
Context4K
Smallest9.2 GB
GGUF
OR
orca mini v7 72b i1
Orca · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
OR
L2 ORCA SFT 0
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
orca mini v9 6 1B Instruct
Orca · Nexesenex
Params1.24B
Context128K
Smallest1.3 GB
GGUF
OR
ORCA1 EXP 0213
Orca · ORCA-AI
Params8.03B
Context8K
Smallest4.9 GB
GGUF
OR
ORCA1 TURBO EXP 0214
Orca · ORCA-AI
Params8.03B
Context128K
Smallest4.9 GB
Tool use

Keep browsing