Jais GGUF models

103 GGUF models in the Jais family, quantized by 12 uploaders. Sizes run from 385M to 72.7B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
JA
Jais Adapted 13b
Jais · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
Coding
JA
Jais Adapted 13b Chat
Jais · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
Coding
JA
Jais Adapted 13b Chat
Jais · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
Coding
JA
Jais Family 13b
Jais · mradermacher
Params13.5B
Context2K
Q4_K_M9.0 GB
Coding
JA
Jais-3-7B
Jais · webmp3
Params9B
Context512K
Q4_K_M5.6 GB
ReasoningTool use
JA
Jais Adapted 7b
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
Coding
JA
Jais Adapted 7b
Jais · RichardErkhov
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
JA
Jais Family 6p7b
Jais · mradermacher
Params7.14B
Context2K
Q4_K_M6.4 GB
Coding
JA
Jais Family 30b 16k
Jais · mradermacher
Params30.8B
Context16K
Q4_K_M27.9 GB
Coding
JA
Jais Family 30b 8k Chat
Jais · mradermacher
Params30.8B
Context8K
Q4_K_M27.9 GB
Coding
JA
Jais-3-0.9B
Jais · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
JA
Jais Adapted 7b Chat
Jais · RichardErkhov
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
JA
Jais Adapted 7b
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
Coding
JA
Jais 2 8B Chat
Jais · inception42
Params8.09B
Context8K
Q4_K_M5.1 GB
GGUF
JA
Jais Adapted 13b Chat
Jais · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
JA
Jais Adapted 70b Chat
Jais · mradermacher
Params69.5B
Context4K
Q4_K_M41.8 GB
Coding
JA
Jais Adapted 70b
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
GGUF
JA
Jais Adapted 13b
Jais · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
JA
Jais Adapted 13b
Jais · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
Coding
JA
Jais Adapted 70b
Jais · mradermacher
Params69.5B
Context4K
Q4_K_M41.8 GB
Coding
JA
Jais Family 30b 16k Chat
Jais · mradermacher
Params30.8B
Context16K
Q4_K_M27.9 GB
Coding
JA
Jais-3-32B
Jais · webmp3
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use
JA
Jais Family 256m Chat
Jais · mradermacher
Params385M
Context2K
Q4_K_M0.3 GB
Coding
JA
Labess 7b chat
Jais · linagora
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
JA
Jais Family 2p7b Chat
Jais · mradermacher
Params2.95B
Context2K
Q4_K_M2.6 GB
Coding
JA
Jais Family 2p7b Chat
Jais · mradermacher
Params2.95B
Context2K
Q4_K_M2.6 GB
Coding
JA
Jais Adapted 7b Chat
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
Coding
JA
Jais Family 1p3b Chat
Jais · mradermacher
Params1.56B
Context2K
Q4_K_M1.0 GB
Coding
JA
Jais Family 1p3b
Jais · mradermacher
Params1.56B
Context2K
Q4_K_M1.0 GB
Coding
JA
Jais Family 13b Chat
Jais · mradermacher
Params13.5B
Context2K
Q4_K_M9.0 GB
Coding

Keep browsing