GGUF models by Bluerosesbutterfly
38 GGUF models quantized by Bluerosesbutterfly on Hugging Face. Sizes run from 1B to 1030B parameters. The longest trained context is 10240K tokens.
About Bluerosesbutterfly on Hugging Face
Bluerosesbutterfly has published 38 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Gemma. The most downloaded are Qwen2.5 3B Instruct Abliterated, Llama 3.3 70B Abliterated and Llama 4 Scout 17B 16E Instruct Abliterated v2.
The quants Bluerosesbutterfly publishes most often are Q4_K_M (25), Q8_0 (3), Q6_K (3) and Q5_K_M (1). Their Q4_K_M files range from 1.9 to 455.9 GB. Parameter counts run from 1B to 1030B, and the longest trained context window is 10240K tokens.
Frequently asked questions
What GGUF models has Bluerosesbutterfly published?
38 models are listed here, mainly from the Qwen, Llama and Gemma families. The most downloaded is Qwen2.5 3B Instruct Abliterated.
Which quants does Bluerosesbutterfly publish?
The most common are Q4_K_M (25 models), Q8_0 (3 models), Q6_K (3 models) and Q5_K_M (1 models).