GGUF models by BenevolenceMessiah

75 GGUF models quantized by BenevolenceMessiah on Hugging Face. Sizes run from 137M to 32.8B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Replete-Coder-Llama3-8B
Llama · BenevolenceMessiah
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
PH
Phi 3 Mini 128k Instruct
Phi · BenevolenceMessiah
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · BenevolenceMessiah
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest23.3 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest34.8 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest26.9 GB
CodingTool use
QW
Qwen3 8B Abliterated
Qwen · BenevolenceMessiah
Params8.19B
Context40K
Smallest8.7 GB
GGUF
GE
gemma-2-9b-it
Gemma · BenevolenceMessiah
Params9.24B
Context8K
Smallest9.8 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest34.8 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest26.9 GB
CodingTool use
CO
Yi Coder 9B
Coder · BenevolenceMessiah
Params8.83B
Context128K
Smallest9.4 GB
Coding
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest18.8 GB
CodingTool use
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · BenevolenceMessiah
Params7.61B
Context32K
Smallest6.3 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest18.6 GB
CodingTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · BenevolenceMessiah
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
QW
Qwen3 4B Abliterated
Qwen · BenevolenceMessiah
Params4.02B
Context40K
Smallest4.3 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest22.6 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest17.2 GB
CodingTool use
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · BenevolenceMessiah
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
NO
Nomic Embed Text v1.5
Nomic · BenevolenceMessiah
Params137M
Context2K
Smallest0.1 GB
Embedding
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · BenevolenceMessiah
Params7.61B
Context32K
Smallest8.1 GB
CodingTool use
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · BenevolenceMessiah
Params7.62B
Context32K
Smallest8.1 GB
CodingTool use
QW
Qwen3 14B Abliterated
Qwen · BenevolenceMessiah
Params14.8B
Context40K
Smallest15.7 GB
GGUF
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · BenevolenceMessiah
Params1.78B
Context128K
Smallest1.9 GB
Tool use
QW
Qwen3 0.6B Abliterated
Qwen · BenevolenceMessiah
Params596M
Context40K
Smallest0.6 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · BenevolenceMessiah
Params32.8B
Context32K
Smallest34.8 GB
CodingTool use
QW
Qwen2.5 14B
Qwen · BenevolenceMessiah
Params14.8B
Context128K
Smallest15.7 GB
Tool use
QW
Qwen2.5 Coder 7B
Qwen · BenevolenceMessiah
Params7.61B
Context32K
Smallest8.1 GB
CodingTool use
OL
OlympicCoder 32B
Olympiccoder · BenevolenceMessiah
Params32.8B
Context32K
Smallest34.8 GB
CodingReasoningTool use

About BenevolenceMessiah on Hugging Face

BenevolenceMessiah has published 75 GGUF models that ggufmodels.com tracks, across families such as Qwen, DeepSeek and Llama. The most downloaded are Replete-Coder-Llama3-8B, Qwen2.5 Coder 32B Instruct Abliterated and Phi 3 Mini 128k Instruct.

The quants BenevolenceMessiah publishes most often are Q8_0 (64), Q6_K (6), Q5_K_M (5) and Q5_K_S (4). Their Q4_K_M files range from 2.4 to 19.9 GB. Parameter counts run from 137M to 32.8B, and the longest trained context window is 986K tokens.

Frequently asked questions

What GGUF models has BenevolenceMessiah published?

75 models are listed here, mainly from the Qwen, DeepSeek and Llama families. The most downloaded is Replete-Coder-Llama3-8B.

Which quants does BenevolenceMessiah publish?

The most common are Q8_0 (64 models), Q6_K (6 models), Q5_K_M (5 models) and Q5_K_S (4 models).

Keep browsing