Orca GGUF models

161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OR
Orca-2-13b-SFT-v4
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
orca mini v9 3 70B i1
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
orca mini v9 1 1B Instruct i1
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
OR
Whale 4B Thinking
Orca · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
OR
orca mini v6 8b i1
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
orca mini v3 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
orca mini 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
OR
Sayan01/TL-ORCA-SFT-0
Orca · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
OR
Orca_Mini_V5_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
models--mergekit-community--mergekit-ties-polycrr
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
orca dolly 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
OR
Orca_Mini_V2_13B
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OR
Orca-2-13b-SFT-v6
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Orca 2 7b
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
orca mini v7 7b
Orca · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OR
orca mini 13b
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OR
Orca SOLAR 4x10.7b i1
Orca · mradermacher
Params36.1B
Context4K
Q4_K_M21.8 GB
Coding
OR
orca mini v9 3 70B
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
orca mini v9 5 3B Instruct i1
Orca · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
OR
orca mini 3B
Orca · juanjgit
Params3.43B
Context—
Smallest1.9 GB
GGUF
OR
orca mini v3 7b
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
orca mini v9 2 70b
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
orca mini v9 5 1B Instruct
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
OR
orca mini 3b i1
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
OR
orca mini 3b
Orca · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
OR
Orca2myth7.2
Orca · TheBigBlender
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
OR
Orca_Mini_V6_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Orca 2 13b SFT v6
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
OR
orca mini 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
OR
Orca_Mini_V5_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing