Blossom GGUF models
120 GGUF models in the Blossom family, quantized by 10 uploaders. Sizes run from 3.09B to 40B parameters. The longest trained context is 512K tokens.
BL
blossom-v5.1-9b
Blossom · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
BL
Blossom V6.3 30B A3B Impotent Heresy
Blossom · mradermacher
Params30.5B
Context32K
Q4_K_M18.6 GB
BL
Blossom v1 3b
Blossom · mradermacher
Params3.64B
Context3K
Q4_K_M2.4 GB
BL
blossom v5.1 9b
Blossom · Azure99
Params8.83B
Context4K
Q4_K_M5.3 GB
BL
Blossom V6.2 14B
Blossom · Azure99
Params14.8B
Context32K
Q4_K_M9.0 GB
BL
Blossom v2 Baichuan 7b
Blossom · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
BL
Blossom V6.2 32B
Blossom · Azure99
Params32.8B
Context128K
Q4_K_M19.9 GB
BL
blossom-v5-4b
Blossom · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
BL
Blossom V6.3 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
BL
blossom v5 4b
Blossom · Azure99
Params3.95B
Context32K
Q4_K_M2.5 GB
BL
blossom-v5-14b
Blossom · bartowski
Params14.2B
Context32K
Q4_K_M9.2 GB
BL
Blossom v5 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
BL
Blossom v2 3b
Blossom · mradermacher
Params3.64B
Context3K
Q4_K_M2.4 GB
BL
Blossom v5 14b
Blossom · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
BL
blossom v5 9b
Blossom · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
BL
Blossom V7 9B
Blossom · Azure99
Params9.2B
Context256K
Q4_K_M5.8 GB
BL
Blossom V6.2 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
BL
Blossom V6.2 36B
Blossom · Azure99
Params36.2B
Context512K
Q4_K_M21.8 GB
BL
Blossom V7 35B A3B
Blossom · Azure99
Params35.5B
Context256K
Q4_K_M21.7 GB
BL
Blossom V6 32B
Blossom · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
BL
Blossom V6.1 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
BL
Blossom_V2
Blossom · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
Blossom v5.1 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
BL
Azure99/blossom-v5-32b
Blossom · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
BL
Blossom V6 14B
Blossom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
BL
Blossom v4 Baichuan2 7b
Blossom · mradermacher
Params7.51B
Context4K
Q4_K_M4.6 GB
BL
Blossom v5 9b
Blossom · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
BL
blossom 40B i1
Blossom · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
BL
Blossom V6 7B
Blossom · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
BL
Blossom v5.1 34b
Blossom · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB