Swallow GGUF models

96 GGUF models in the Swallow family, quantized by 7 uploaders. Sizes run from 6.74B to 70.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SW
Swallow-70b-instruct-v0.1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
Roleplay
SW
Swallow 7b Instruct Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1 Qlora Amenokaku Code
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
Coding
SW
Swallow MS 7b Instruct v0.1
Swallow · tensorblock
Params7.33B
Context4K
Smallest2.8 GB
GGUF
SW
Swallow 70b RP
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
Roleplay
SW
L3.1 70b Swallow Saigetsu i1
Swallow · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SW
Swallow 7b Instruct Hf
Swallow · tensorblock
Params6.83B
Context4K
Smallest2.6 GB
GGUF
SW
swallow-3-8B-sqlcoder-2x8B
Swallow · keitokei1994
Params13.7B
Context8K
Q4_K_M8.3 GB
Coding
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MoE 2x13B v0.1
Swallow · mradermacher
Params21.6B
Context4K
Q4_K_M13.1 GB
GGUF
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1 ChatVector
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7b hf CodeSkill
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow 7b Hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1 ChatSkill Wizard
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7b Hf Oasst1 21k Ja
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
KaraKaraWitch/L3.1-70b-Swallow-Saigetsu
Swallow · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SW
Swallow-70b-instruct-hf
Swallow · RichardErkhov
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SW
Swallow 7b Hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow 13b NVE Hf
Swallow · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SW
Swallow 7b Hf Oasst1 21k Ja
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing