Sarashina GGUF models

99 GGUF models in the Sarashina family, quantized by 34 uploaders. Sizes run from 793M to 70.1B parameters. The longest trained context is 16K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
sarashina2.2 5.48B instruct no tuning
Sarashina · mradermacher
Params5.48B
Context8K
Q4_K_M3.3 GB
Tool use
SA
Sbintuitions.Sarashina2.2 3b Instruct v0.1
Sarashina · DevQuasar-9
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
yamato 3b v5 r128 legal
Sarashina · FiShota
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
Sarashina2.2 Tts
Sarashina · orsele
Params810M
Context8K
Q4_K_M0.5 GB
Tool use
SA
Sarashina2.2 3b RP v0.2
Sarashina · Aratako
Params3.36B
Context8K
Q4_K_M2.1 GB
RoleplayTool use
SA
Sarashina2.2 3b RP v0.1
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
RoleplayTool use
SA
Sarashina 13B Finetuned v1
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
SA
Sarashina2.1 1b
Sarashina · mradermacher
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
SA
Sarashina Embedding v2 1b
Sarashina · mradermacher
Params1.22B
Context8K
Q4_K_M0.8 GB
Embedding
SA
Sarashina2.2 3b OpenCodeReasoning Random 100k
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
CodingReasoningTool use
SA
Sarashina2 70b
Sarashina · mradermacher
Params70.1B
Context8K
Q4_K_M42.2 GB
GGUF
SA
Sarashina 13B Finetuned v3
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
SA
Sarashina2.2 3b Cot Sft 20250920
Sarashina · mradermacher
Params3.36B
Context16K
Q4_K_M2.1 GB
ReasoningTool use
SA
Sarashina2.1 1b
Sarashina · DevQuasar-6
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · tatsuyaaaaaaa
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
sarashina2.2 3Bx8 moe
Sarashina · mradermacher
Params16.6B
Context8K
Q4_K_M10.1 GB
Tool use
SA
Sarashina2.2-Vision 3B
Sarashina · rinrin0413
Params3.36B
Context8K
Q4_K_M2.1 GB
Vision
SA
Sbintuitions.Sarashina2.2 1b
Sarashina · DevQuasar-5
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · Japan-AI-Consulting
Params793M
Context8K
Q4_K_M0.5 GB
Tool use
SA
yamato 3b v4 r64 legal
Sarashina · FiShota
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
sarashina2.2 3b sft v4 dpo
Sarashina · FiShota
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mradermacher
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use
SA
Sarashina2.2 3b OpenMathReasoning Random 100k
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
ReasoningTool use
SA
sarashina2.2 3Bx4 moe
Sarashina · mradermacher
Params7.76B
Context8K
Q4_K_M4.7 GB
Tool use
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · OsakanaTeishoku
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · Japan-AI-Consulting
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use
SA
yamato 3b v1 legal
Sarashina · FiShota
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SA
sarashina2.2 0.5B hypercloning
Sarashina · mradermacher
Params2.65B
Context8K
Q4_K_M1.6 GB
Tool use
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · keitokei1994
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use
SA
Sbintuitions.Sarashina2.2 1b Instruct v0.1
Sarashina · DevQuasar-9
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use

Keep browsing