Blossom GGUF models

120 GGUF models in the Blossom family, quantized by 10 uploaders. Sizes run from 3.09B to 40B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BL
Yi blossom 40B
Blossom · mradermacher
Params18.8B
Context4K
Q4_K_M11.3 GB
GGUF
BL
Blossom v1 Baichuan 7b
Blossom · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
BL
Blossom V6.3 14B
Blossom · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
Blossom V3_1 Baichuan2 7b
Blossom · mradermacher
Params7.51B
Context4K
Q4_K_M4.6 GB
GGUF
BL
Blossom V6 7B
Blossom · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
BL
Blossom v5 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BL
Blossom V7 27B
Blossom · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
BL
Blossom V7 9B
Blossom · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
BL
Blossom V7.1 35B A3B
Blossom · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
BL
Blossom V6.1 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom V6.3 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom V7.1 35B A3B
Blossom · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
BL
Blossom V3_1 Baichuan2 13b
Blossom · mradermacher
Params13.9B
Context4K
Q4_K_M9.0 GB
GGUF
BL
Blossom v5.1 34b
Blossom · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BL
Blossom V6.1 32B
Blossom · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BL
blossom-v5.1-9b
Blossom · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
Blossom V7 27B
Blossom · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
BL
blossom 2GB
Blossom · Jay1121
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
BL
Blossom v3 Baichuan2 7b
Blossom · mradermacher
Params7.51B
Context4K
Q4_K_M4.6 GB
GGUF
BL
Blossom V7 35B A3B
Blossom · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
BL
Blossom V6.2 14B
Blossom · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
blossom v5 32b
Blossom · Azure99
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
BL
Blossom V7 9B
Blossom · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom V6.2 14B
Blossom · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
Blossom V6.2 8B
Blossom · Azure99
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom v2 3b
Blossom · mradermacher
Params3.64B
Context3K
Q4_K_M2.4 GB
GGUF
BL
Blossom V7.1 35B A3B
Blossom · Azure99
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
BL
Blossom V6 32B
Blossom · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BL
Blossom V7.1 9B
Blossom · Azure99
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision

Keep browsing