Orca GGUF models
161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.
OR
Orca 2 13b SFT v6
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
OR
orca mini 3B
Orca · zoltanctoth
Params3.43B
Context—
Smallest1.9 GB
OR
Orca 2 13b SFT v4
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
OR
orca agentinstruct 1M v1 cleaned
Orca · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
orca mini v5 8b
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
orca mini v9 4 70B
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Orca SOLAR 4x10.7b
Orca · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
OR
orca mini v9 5 1B Instruct preview i1
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
OR
Orca 2 13b
Orca · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
OR
Vmajor Orca2 13B Selfmerge 26B
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
OR
Orca Mini v9.6 L3.2 1B Erotiquant3
Orca · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
OR
Orca 2 13b Abliterated
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
OR
Orca 2 7b
Orca · oieieio
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
Orca Agent v0.1
Orca · YorkieOH10
Params14.8B
Context40K
Smallest15.7 GB
OR
orca-mini-3b.ggmlv3.q4_1.bin
Orca · markwitt
Params3.43B
Context2K
Smallest2.1 GB
OR
Orca 2 7b
Orca · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math Lora
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
OR
orca mini v3 7b Q4 0 4 4
Orca · flyfishstudio
Params6.74B
Context4K
Smallest3.8 GB
OR
orca mini 3B
Orca · andrewamirr
Params3.43B
Context—
Smallest1.9 GB
OR
Orca2 7b Enlighten V2 merged
Orca · codersan
Params6.74B
Context4K
Smallest3.9 GB
OR
orca mini v7 7b Q6 K
Orca · Stark2008
Params7.62B
Context32K
Smallest6.3 GB
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
OR
orca mini v3 7b Q4 0 4 8
Orca · flyfishstudio
Params6.74B
Context4K
Smallest3.8 GB
OR
orca viet
Orca · TakaroKai
Params3.88B
Context128K
Smallest7.8 GB
OR
orca mini 3B
Orca · santhoshpalfin
Params3.43B
Context—
Smallest1.9 GB
OR
Orca2 Nova 13B
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
OR
Orca 2 7b
Orca · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
OR
orca mini 3B 1
Orca · sandosh
Params3.43B
Context—
Smallest1.9 GB
OR
orca_mini_3b
Orca · SansarK
Params3.43B
Context2K
Smallest2.1 GB
OR
orca mini 3b gguf2 q4 0
Orca · nuradHub
Params3.43B
Context2K
Smallest2.0 GB