Orca GGUF models
161 GGUF models in the Orca family, quantized by 36 uploaders. Sizes run from 1.1B to 72.7B parameters. The longest trained context is 256K tokens.
OR
Orca-2-13b-SFT-v4
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
OR
orca mini v9 3 70B i1
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
orca mini v9 1 1B Instruct i1
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
OR
Whale 4B Thinking
Orca · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
OR
orca mini v6 8b i1
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
orca mini v3 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
OR
orca mini 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
OR
Sayan01/TL-ORCA-SFT-0
Orca · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
OR
Orca_Mini_V5_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
models--mergekit-community--mergekit-ties-polycrr
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
orca dolly 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
OR
Orca_Mini_V2_13B
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
OR
Orca-2-13b-SFT-v6
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
OR
Orca 2 7b
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
orca mini v7 7b
Orca · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OR
orca mini 13b
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
OR
Orca SOLAR 4x10.7b i1
Orca · mradermacher
Params36.1B
Context4K
Q4_K_M21.8 GB
OR
orca mini v9 3 70B
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
orca mini v9 5 3B Instruct i1
Orca · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
OR
orca mini 3B
Orca · juanjgit
Params3.43B
Context—
Smallest1.9 GB
OR
orca mini v3 7b
Orca · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
orca mini v9 2 70b
Orca · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
orca mini v9 5 1B Instruct
Orca · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
OR
orca mini 3b i1
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
OR
orca mini 3b
Orca · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
OR
Orca2myth7.2
Orca · TheBigBlender
Params20B
Context4K
Q4_K_M12.0 GB
OR
Orca_Mini_V6_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
Orca 2 13b SFT v6
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
OR
orca mini 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
OR
Orca_Mini_V5_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB