Blossom GGUF models

120 GGUF models in the Blossom family, quantized by 10 uploaders. Sizes run from 3.09B to 40B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BL
blossom-v5.1-9b
Blossom · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
Blossom V6.3 30B A3B Impotent Heresy
Blossom · mradermacher
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
BL
Blossom v1 3b
Blossom · mradermacher
Params3.64B
Context3K
Q4_K_M2.4 GB
GGUF
BL
blossom v5.1 9b
Blossom · Azure99
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
Blossom V6.2 14B
Blossom · Azure99
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
Blossom v2 Baichuan 7b
Blossom · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
BL
Blossom V6.2 32B
Blossom · Azure99
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BL
blossom-v5-4b
Blossom · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
BL
Blossom V6.3 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
BL
blossom v5 4b
Blossom · Azure99
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
BL
blossom-v5-14b
Blossom · bartowski
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
BL
Blossom v5 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BL
Blossom v2 3b
Blossom · mradermacher
Params3.64B
Context3K
Q4_K_M2.4 GB
GGUF
BL
Blossom v5 14b
Blossom · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
BL
blossom v5 9b
Blossom · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
Blossom V7 9B
Blossom · Azure99
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
BL
Blossom V6.2 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
BL
Blossom V6.2 36B
Blossom · Azure99
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
BL
Blossom V7 35B A3B
Blossom · Azure99
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
BL
Blossom V6 32B
Blossom · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BL
Blossom V6.1 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom_V2
Blossom · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BL
Blossom v5.1 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BL
Azure99/blossom-v5-32b
Blossom · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
BL
Blossom V6 14B
Blossom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
BL
Blossom v4 Baichuan2 7b
Blossom · mradermacher
Params7.51B
Context4K
Q4_K_M4.6 GB
GGUF
BL
Blossom v5 9b
Blossom · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
blossom 40B i1
Blossom · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
GGUF
BL
Blossom V6 7B
Blossom · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
BL
Blossom v5.1 34b
Blossom · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing