Jais GGUF models

103 GGUF models in the Jais family, quantized by 12 uploaders. Sizes run from 385M to 72.7B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
JA
Jais Family 590m Chat
Jais · mradermacher
Params771M
Context2K
Q4_K_M0.5 GB
Coding
JA
Jais Family 590m
Jais · mradermacher
Params771M
Context2K
Q4_K_M0.5 GB
Coding
JA
Jais Family 590m Chat
Jais · mradermacher
Params771M
Context2K
Q4_K_M0.5 GB
Coding
JA
Jais Family 6p7b Chat
Jais · mradermacher
Params7.14B
Context2K
Q4_K_M6.4 GB
Coding
JA
Jais Family 1p3b Chat
Jais · mradermacher
Params1.56B
Context2K
Q4_K_M1.0 GB
Coding
JA
Jais Inception 7b V0.2
Jais · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JA
Jais-Inception-70b-V1.2.2
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
JA
JAIS2 IT 0.3
Jais · mradermacher
Params8.09B
Context8K
Q4_K_M5.1 GB
GGUF
JA
Jais-Inception-70b-V1.2
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
JA
Jais Family 256m
Jais · mradermacher
Params385M
Context2K
Q4_K_M0.3 GB
Coding
JA
Jais Family 590m
Jais · mradermacher
Params771M
Context2K
Q4_K_M0.5 GB
Coding
JA
Jais Family 2p7b
Jais · mradermacher
Params2.95B
Context2K
Q4_K_M2.6 GB
Coding
JA
Jais Family 30b 8k Chat
Jais · mradermacher
Params30.8B
Context8K
Q4_K_M27.9 GB
Coding
JA
Jais Family 30b 16k
Jais · mradermacher
Params30.8B
Context16K
Q4_K_M27.9 GB
Coding
JA
Jais Inception 70b V1.1
Jais · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
JA
Jais adapted 7B Reflection Tuning Natural Farmer Q4 K M
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
JA
Jais Adapted 13b Chat
Jais · Solshine
Params13.3B
Context4K
Q4_K_M8.1 GB
Coding
JA
Jais 2 70B Chat
Jais · inception42
Params72B
Context8K
Q4_K_M44.9 GB
GGUF
JA
Jais-Inception-7b-V0.2
Jais · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JA
Jais-70b
Jais · mradermacher
Params70.6B
Context14K
Q4_K_M42.5 GB
GGUF
JA
jais adapted 7b chat Natural Farmer Q8
Jais · Solshine
Params6.74B
Context4K
Smallest7.2 GB
GGUF
JA
Jais-70b
Jais · mradermacher
Params70.6B
Context14K
Q4_K_M42.5 GB
GGUF
JA
Jais-70b-Preview
Jais · mradermacher
Params70.6B
Context14K
Q4_K_M42.5 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest13.4 GB
Coding
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest11.0 GB
Coding
JA
jais family 256m chat Natural Farmer Q8
Jais · Solshine
Params6.74B
Context4K
Smallest7.2 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Q4_K_M12.1 GB
Coding
JA
Jais Family 1p3b
Jais · mradermacher
Params1.56B
Context2K
Q4_K_M1.0 GB
Coding
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest9.4 GB
Coding
JA
jais-30b-chat-v1
Jais · dormosh
Params30.8B
Context2K
Smallest38.9 GB
GGUF

Keep browsing