Sarashina GGUF models

99 GGUF models in the Sarashina family, quantized by 34 uploaders. Sizes run from 793M to 70.1B parameters. The longest trained context is 16K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
flicklog sarashina
Sarashina · miurror
Params793M
Context8K
Q4_K_M0.5 GB
Tool use
SA
Sarashina Embedding v2 1b
Sarashina · kushalc1
Params1.22B
Context8K
Q4_K_M0.8 GB
Embedding
SA
sarashina2.2 12B moe v0.1
Sarashina · DataPilot
Params7.76B
Context8K
Q4_K_M4.7 GB
Tool use
SA
Sarashina2.2 3B Chat Ft
Sarashina · beezza
Params3.36B
Context8K
Smallest3.6 GB
GGUF
SA
sarashina2.2 0.5b instruct v0.1 gguf q4 k m
Sarashina · keisuke-miyako
Params793M
Context8K
Q4_K_M0.5 GB
Tool use
SA
Sarashina2 70b
Sarashina · grapevine-AI
Params70.1B
Context8K
Q4_K_M42.2 GB
GGUF
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · tuanvu92
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use
SA
sarashina2.2 0.5b instruct v0.1 gguf q8 0
Sarashina · keisuke-miyako
Params793M
Context8K
Smallest0.8 GB
Tool use
SA
Sarashina2 13b
Sarashina · urkz
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF

Keep browsing