GGUF models by Azure99

40 GGUF models quantized by Azure99 on Hugging Face. Sizes run from 1.84B to 36.2B parameters. The longest trained context is 512K tokens.

Most downloadedNewestLargestLongest contextSmallest
BL
Blossom V7.1 27B
Blossom · Azure99
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Blossom V6.4 27B
Qwen · Azure99
Params26.9B
Context256K
Q4_K_M16.5 GB
Vision
QW
Blossom V6.4 9B
Qwen · Azure99
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Blossom V6.3 14B
Qwen · Azure99
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
blossom v5 32b
Blossom · Azure99
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Blossom V6.3 30B A3B
Qwen · Azure99
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
BL
Blossom V6.2 8B
Blossom · Azure99
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom V7.1 35B A3B
Blossom · Azure99
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
BL
Blossom V7.1 9B
Blossom · Azure99
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
BL
blossom v5.1 9b
Blossom · Azure99
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
BL
Blossom V6.2 14B
Blossom · Azure99
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
BL
Blossom V6.2 32B
Blossom · Azure99
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BL
blossom v5 4b
Blossom · Azure99
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
QW
Blossom V6.4 35B A3B
Qwen · Azure99
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
BL
Blossom V7 9B
Blossom · Azure99
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
BL
Blossom V6.2 36B
Blossom · Azure99
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
BL
Blossom V7 35B A3B
Blossom · Azure99
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
SE
Blossom V6.3 36B
Seed · Azure99
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
QW
blossom v4 qwen1 5 14b
Qwen · Azure99
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
QW
Blossom V6.3 8B
Qwen · Azure99
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BL
Blossom V6.1 8B
Blossom · Azure99
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
YI
blossom v4 yi 34b
Yi · Azure99
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
blossom v5 llama3 8b
Llama · Azure99
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
blossom v4 qwen1 5 7b
Qwen · Azure99
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
blossom v4 qwen 14b
Qwen · Azure99
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
BL
Blossom V7 27B
Blossom · Azure99
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
blossom v4 qwen 1 8b
Qwen · Azure99
Params1.84B
Context8K
Q4_K_M1.2 GB
GGUF
BL
blossom v5.1 34b
Blossom · Azure99
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
blossom v4 qwen1 5 4b
Qwen · Azure99
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
BL
Blossom V6.1 32B
Blossom · Azure99
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF

About Azure99 on Hugging Face

Azure99 has published 40 GGUF models that ggufmodels.com tracks, across families such as Blossom, Qwen and Yi. The most downloaded are Blossom V7.1 27B, Blossom V6.4 27B and Blossom V6.4 9B.

The quants Azure99 publishes most often are Q6_K (40), Q5_K_S (40), Q5_K_M (40) and Q4_K_S (40). Their Q4_K_M files range from 1.2 to 21.8 GB. Parameter counts run from 1.84B to 36.2B, and the longest trained context window is 512K tokens.

Frequently asked questions

What GGUF models has Azure99 published?

40 models are listed here, mainly from the Blossom, Qwen and Yi families. The most downloaded is Blossom V7.1 27B.

Which quants does Azure99 publish?

The most common are Q6_K (40 models), Q5_K_S (40 models), Q5_K_M (40 models) and Q4_K_S (40 models).

Keep browsing