GGUF models by Bluerosesbutterfly
38 GGUF models quantized by Bluerosesbutterfly on Hugging Face. Sizes run from 1B to 1030B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Abliterated Q6
Qwen · Bluerosesbutterfly
Params26.9B
Context256K
Smallest22.1 GB
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · Bluerosesbutterfly
Params122B
Context256K
Smallest78.7 GB
QW
Qwen2.5 7B Instruct
Qwen · Bluerosesbutterfly
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 72B Abliterated
Qwen · Bluerosesbutterfly
Params72.7B
Context32K
Smallest47.4 GB
GE
Gemma 3 27b It Abliterated
Gemma · Bluerosesbutterfly
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.6 27B Claude Opus Sonnet DistilledV2 MTP
Qwen · Bluerosesbutterfly
Params27.3B
Context256K
Smallest29.0 GB
QW
Qwen3.5 122B Heretic
Qwen · Bluerosesbutterfly
Params122B
Context256K
Q4_K_M74.2 GB
GL
GLM5 Q4KM
GLM · Bluerosesbutterfly
Params754B
Context198K
Q4_K_M455.9 GB