Sarvam GGUF models

111 GGUF models in the Sarvam family, quantized by 56 uploaders. Sizes run from 13M to 106B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
Sarvam Translate
Sarvam · spitfire4794
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Sarvam 2b v0.5
Sarvam · rachittshah
Params2.51B
Context8K
Smallest2.1 GB
GGUF
SA
Sarvam 30b Hf
Sarvam · ThatCultivator
Params32.2B
Context128K
Q4_K_M19.6 GB
ReasoningTool use
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest10.4 GB
Reasoning
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest19.3 GB
Reasoning
SA
Sarvam 30b
Sarvam · achu00
Params32.2B
Context128K
Smallest15.7 GB
GGUF
SA
Sarvam 1
Sarvam · Savyasaachin
Params2.53B
Context8K
Smallest2.7 GB
Tool use
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest12.4 GB
Reasoning
SA
Sarvam 1 2b Instruct
Sarvam · Savyasaachin
Params2.53B
Context8K
Smallest2.7 GB
GGUF
SA
Sarvam 30b
Sarvam · Aditya02
Params32.2B
Context128K
Smallest19.6 GB
ReasoningTool use
SA
Samastam
Sarvam · hathibelagal
Params2.53B
Context8K
Smallest2.7 GB
GGUF
SA
Sarvam Translate
Sarvam · fischerman
Params3.88B
Context128K
Smallest1.7 GB
GGUF
SA
sarvam ai finetuning distillation v4 1 F32
Sarvam · Savyasaachin
Params24M
Context—
Smallest0.1 GB
GGUF
SA
Sarvam Translate
Sarvam · shinshekai
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest13.5 GB
Reasoning
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest17.7 GB
Reasoning
SA
Sarvam M
Sarvam · tifin-india
Params23.6B
Context32K
Smallest11.5 GB
Reasoning
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest2.8 GB
GGUF
SA
sarvam-m
Sarvam · varshu23
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
SA
Sarvam 1
Sarvam · RichardErkhov
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
SA
Sarvam 2b v0.5
Sarvam · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB
GGUF
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest2.8 GB
GGUF
SA
Sarvam M
Sarvam · sizzlebop
Params23.6B
Context32K
Smallest25.1 GB
Reasoning
SA
Sarvam M
Sarvam · Savyasaachin
Params23.6B
Context32K
Smallest13.4 GB
Reasoning
SA
Sarvam 1
Sarvam · dhrubasumatary
Params2.53B
Context8K
Smallest5.1 GB
Tool use
SA
Sarvam Translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
sarvam 1.5
Sarvam · mashriram
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision

Keep browsing