Swallow GGUF models
96 GGUF models in the Swallow family, quantized by 7 uploaders. Sizes run from 6.74B to 70.6B parameters. The longest trained context is 128K tokens.
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SW
Swallow-7b-plus-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
Swallow-70b-NVE-instruct-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
SW
Swallow-13b-instruct-v0.1
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
SW
Swallow MX 8x7b NVE v0.1
Swallow · RichardErkhov
Params46.7B
Context4K
Q4_K_M28.4 GB
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
031 Swallow 8b 0.5 Base V2New Dpo405B
Swallow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
SW
L3.1 70b Swallow Saigetsu
Swallow · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SW
Swallow MoE 2x13B v0.1 i1
Swallow · mradermacher
Params21.6B
Context4K
Q4_K_M13.1 GB
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
Swallow 70b RP i1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
SW
Swallow MS 7b instruct v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow 7b Instruct v0.1
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
Swallow MoE 4x7B Lisa
Swallow · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
SW
Swallow Hermes St v1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
SW
Swallow MS 7b v0.1
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow MS 7b v0.1 qlora oasst1 jmultiwoz dolly amenokaku
Swallow · mradermacher
Params7.33B
Context4K
Q4_K_M4.4 GB
SW
Swallow 70b NVE RP i1
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SW
Swallow 70b NVE RP
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SW
Swallow 7b Hf Oasst1 21k Ja
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB