Sarashina GGUF models
99 GGUF models in the Sarashina family, quantized by 34 uploaders. Sizes run from 793M to 70.1B parameters. The longest trained context is 16K tokens.
SA
flicklog sarashina
Sarashina · miurror
Params793M
Context8K
Q4_K_M0.5 GB
SA
Sarashina Embedding v2 1b
Sarashina · kushalc1
Params1.22B
Context8K
Q4_K_M0.8 GB
SA
sarashina2.2 12B moe v0.1
Sarashina · DataPilot
Params7.76B
Context8K
Q4_K_M4.7 GB
SA
Sarashina2.2 3B Chat Ft
Sarashina · beezza
Params3.36B
Context8K
Smallest3.6 GB
SA
sarashina2.2 0.5b instruct v0.1 gguf q4 k m
Sarashina · keisuke-miyako
Params793M
Context8K
Q4_K_M0.5 GB
SA
Sarashina2 70b
Sarashina · grapevine-AI
Params70.1B
Context8K
Q4_K_M42.2 GB
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · tuanvu92
Params1.41B
Context8K
Q4_K_M0.9 GB
SA
sarashina2.2 0.5b instruct v0.1 gguf q8 0
Sarashina · keisuke-miyako
Params793M
Context8K
Smallest0.8 GB
SA
Sarashina2 13b
Sarashina · urkz
Params13.7B
Context4K
Q4_K_M8.4 GB