Swallow GGUF models

96 GGUF models in the Swallow family, quantized by 7 uploaders. Sizes run from 6.74B to 70.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-7b-plus-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-70b-NVE-instruct-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SW
Swallow-13b-instruct-v0.1
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow MX 8x7b NVE v0.1
Swallow · RichardErkhov
Params46.7B
Context4K
Q4_K_M28.4 GB
GGUF
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
031 Swallow 8b 0.5 Base V2New Dpo405B
Swallow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
L3.1 70b Swallow Saigetsu
Swallow · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SW
Swallow MoE 2x13B v0.1 i1
Swallow · mradermacher
Params21.6B
Context4K
Q4_K_M13.1 GB
GGUF
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow 70b RP i1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SW
Swallow MS 7b instruct v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7b Instruct v0.1
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow MoE 4x7B Lisa
Swallow · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
CodingRoleplay
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow Hermes St v1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
Tool use
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
SW
Swallow MS 7b v0.1 qlora oasst1 jmultiwoz dolly amenokaku
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
Coding
SW
Swallow 70b NVE RP i1
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
SW
Swallow 70b NVE RP
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
SW
Swallow 7b Hf Oasst1 21k Ja
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing