Sarvam GGUF models

111 GGUF models in the Sarvam family, quantized by 56 uploaders. Sizes run from 13M to 106B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
sarvam-m
Sarvam · sarvamai
Params23.6B
Context32K
Smallest25.1 GB
Reasoning
SA
Sarvam 30b
Sarvam · mtrajan
Params32.2B
Context128K
Q4_K_M19.6 GB
ReasoningTool use
SA
krishi sathi sarvam 2b multilingual
Sarvam · ganmoor-ai-labs
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
SA
Sarvam 105b
Sarvam · limegreenpeper1
Params106B
Context128K
Q4_K_M64.2 GB
ReasoningTool use
SA
Sarvam 30b
Sarvam · infergo
Params32.2B
Context128K
Q4_K_M19.6 GB
ReasoningTool use
SA
Sarvam 105B
Sarvam · Aaravomega
Params106B
Context128K
Smallest112.7 GB
ReasoningTool use
SA
Sarvam 2b v0.5
Sarvam · Sri-Vigneshwar-DJ
Params2.51B
Context8K
Smallest2.7 GB
GGUF
SA
sarvam 30b Spiral
Sarvam · Reinforce-ai
Params30B
Context128K
Smallest18.3 GB
GGUF
SA
Sarvamai_Sarvam M
Sarvam · smarttasks
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningTool use
SA
Sarvam 1
Sarvam · ulkaa
Params2.53B
Context8K
Q4_K_M1.5 GB
ReasoningTool use
SA
krishi sathi sarvam 2b
Sarvam · ganmoor-ai-labs
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
SA
sarvam 1 seenu chat
Sarvam · seenuvasan1947
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
SA
sarvam translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest3.2 GB
GGUF
SA
sarvam translate 8bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
Sarvam Translate
Sarvam · Open4bits
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest16.8 GB
Reasoning
SA
Sarvam 1
Sarvam · Open4bits
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
SA
sarvam translate 4bit
Sarvam · Mugunth123
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
sarvam 1 v0.5
Sarvam · tripathyShaswata
Params2.51B
Context8K
Smallest2.7 GB
GGUF
SA
sarvam 30b GGUF IQ2 S surgical
Sarvam · Aaravomega
Params32.2B
Context128K
Smallest0.2 GB
GGUF
SA
sarvam-m
Sarvam · sarvamai
Params23.6B
Context32K
Smallest47.2 GB
Reasoning
SA
Sarvam 1
Sarvam · dg10911
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest11.5 GB
Reasoning
SA
Sarvam Translate
Sarvam · trysem
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest16.3 GB
Reasoning
SA
Sarvam 1
Sarvam · Edge-Quant
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest47.2 GB
Reasoning
SA
Sarvamai Sarvam M
Sarvam · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
Reasoning
SA
Sarvam 2b v0.5
Sarvam · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF

Keep browsing