Orca GGUF models

161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
Orca 2 13b SFT v6
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
OR
orca mini 3B
Orca · zoltanctoth
Params3.43B
Context—
Smallest1.9 GB
GGUF
OR
Orca 2 13b SFT v4
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
OR
orca agentinstruct 1M v1 cleaned
Orca · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
orca mini v5 8b
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
orca mini v9 4 70B
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Orca SOLAR 4x10.7b
Orca · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
Coding
OR
orca mini v9 5 1B Instruct preview i1
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
OR
Orca 2 13b
Orca · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Vmajor Orca2 13B Selfmerge 26B
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
OR
Orca Mini v9.6 L3.2 1B Erotiquant3
Orca · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
GGUF
OR
Orca 2 13b Abliterated
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Orca 2 7b
Orca · oieieio
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
Orca Agent v0.1
Orca · YorkieOH10
Params14.8B
Context40K
Smallest15.7 GB
Coding
OR
orca-mini-3b.ggmlv3.q4_1.bin
Orca · markwitt
Params3.43B
Context2K
Smallest2.1 GB
GGUF
OR
Orca 2 7b
Orca · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math Lora
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OR
orca mini v3 7b Q4 0 4 4
Orca · flyfishstudio
Params6.74B
Context4K
Smallest3.8 GB
GGUF
OR
orca mini 3B
Orca · andrewamirr
Params3.43B
Context—
Smallest1.9 GB
GGUF
OR
Orca2 7b Enlighten V2 merged
Orca · codersan
Params6.74B
Context4K
Smallest3.9 GB
Coding
OR
orca mini v7 7b Q6 K
Orca · Stark2008
Params7.62B
Context32K
Smallest6.3 GB
GGUF
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OR
orca mini v3 7b Q4 0 4 8
Orca · flyfishstudio
Params6.74B
Context4K
Smallest3.8 GB
GGUF
OR
orca viet
Orca · TakaroKai
Params3.88B
Context128K
Smallest7.8 GB
GGUF
OR
orca mini 3B
Orca · santhoshpalfin
Params3.43B
Context—
Smallest1.9 GB
GGUF
OR
Orca2 Nova 13B
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Orca 2 7b
Orca · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
OR
orca mini 3B 1
Orca · sandosh
Params3.43B
Context—
Smallest1.9 GB
GGUF
OR
orca_mini_3b
Orca · SansarK
Params3.43B
Context2K
Smallest2.1 GB
GGUF
OR
orca mini 3b gguf2 q4 0
Orca · nuradHub
Params3.43B
Context2K
Smallest2.0 GB
GGUF

Keep browsing