Sarvam GGUF models
111 GGUF models in the Sarvam family, quantized by 56 uploaders. Sizes run from 13M to 106B parameters. The longest trained context is 256K tokens.
SA
sarvam-m
Sarvam · sarvamai
Params23.6B
Context32K
Smallest25.1 GB
SA
Sarvam 30b
Sarvam · mtrajan
Params32.2B
Context128K
Q4_K_M19.6 GB
SA
krishi sathi sarvam 2b multilingual
Sarvam · ganmoor-ai-labs
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
Sarvam 105b
Sarvam · limegreenpeper1
Params106B
Context128K
Q4_K_M64.2 GB
SA
Sarvam 30b
Sarvam · infergo
Params32.2B
Context128K
Q4_K_M19.6 GB
SA
Sarvam 105B
Sarvam · Aaravomega
Params106B
Context128K
Smallest112.7 GB
SA
Sarvam 2b v0.5
Sarvam · Sri-Vigneshwar-DJ
Params2.51B
Context8K
Smallest2.7 GB
SA
sarvam 30b Spiral
Sarvam · Reinforce-ai
Params30B
Context128K
Smallest18.3 GB
SA
Sarvamai_Sarvam M
Sarvam · smarttasks
Params23.6B
Context32K
Q4_K_M14.3 GB
SA
Sarvam 1
Sarvam · ulkaa
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
krishi sathi sarvam 2b
Sarvam · ganmoor-ai-labs
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
sarvam 1 seenu chat
Sarvam · seenuvasan1947
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
sarvam translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest3.2 GB
SA
sarvam translate 8bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest4.1 GB
SA
Sarvam Translate
Sarvam · Open4bits
Params3.88B
Context128K
Q4_K_M2.5 GB
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest16.8 GB
SA
Sarvam 1
Sarvam · Open4bits
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
sarvam translate 4bit
Sarvam · Mugunth123
Params3.88B
Context128K
Q4_K_M2.5 GB
SA
sarvam 1 v0.5
Sarvam · tripathyShaswata
Params2.51B
Context8K
Smallest2.7 GB
SA
sarvam 30b GGUF IQ2 S surgical
Sarvam · Aaravomega
Params32.2B
Context128K
Smallest0.2 GB
SA
sarvam-m
Sarvam · sarvamai
Params23.6B
Context32K
Smallest47.2 GB
SA
Sarvam 1
Sarvam · dg10911
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest11.5 GB
SA
Sarvam Translate
Sarvam · trysem
Params3.88B
Context128K
Q4_K_M2.5 GB
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Q4_K_M14.3 GB
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest16.3 GB
SA
Sarvam 1
Sarvam · Edge-Quant
Params2.53B
Context8K
Q4_K_M1.5 GB
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest47.2 GB
SA
Sarvamai Sarvam M
Sarvam · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
SA
Sarvam 2b v0.5
Sarvam · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.5 GB