GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Impish_LLAMA_4B_V2
Llama · SicariusSicariiStuff
Params4.5B
Context128K
Q4_K_M2.8 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest9.9 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
AS
Assistant Pepe 70B
Assistant · SicariusSicariiStuff
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AS
Assistant_Pepe_32B
Assistant · SicariusSicariiStuff
Params32.8B
Context40K
Smallest26.9 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest3.6 GB
GGUF
AN
Angelic Eclipse 12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen3.5 0.8B Abliterated
Qwen · SicariusSicariiStuff
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
2B
2B ad iMatrix
SicariusSicariiStuff
Params2.61B
Context8K
Smallest0.8 GB
GGUF
ZI
Zion Alpha Instruction Tuned
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Abliterated
Llama · SicariusSicariiStuff
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest4.9 GB
GGUF
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest4.9 GB
GGUF
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest2.0 GB
GGUF
TE
Tenebra
Tenebra · SicariusSicariiStuff
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GE
TheDrummer_Gemmasutra Mini 2B v1
Gemma · SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.6 GB
GGUF
NA
Nano_Imp_1B
Nano · SicariusSicariiStuff
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
IM
Impish Magic 24B
Impish · SicariusSicariiStuff
Params23.6B
Context40K
Smallest10.4 GB
GGUF
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest3.6 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
ZI
Zion_Alpha
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Smallest3.5 GB
GGUF
QW
Qwen3.5 2B_Abliterated
Qwen · SicariusSicariiStuff
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

About SicariusSicariiStuff on Hugging Face

SicariusSicariiStuff has published 171 GGUF models that ggufmodels.com tracks, across families such as Llama, Impish and Qwen. The most downloaded are Impish_LLAMA_4B_V2, Impish_Bloodmoon_12B and Impish_QWEN_14B 1M.

The quants SicariusSicariiStuff publishes most often are Q4_K_M (45), Q4_0 (45), Q5_K_M (42) and Q6_K (41). Their Q4_K_M files range from 0.5 to 47.4 GB. Parameter counts run from 752M to 72.7B, and the longest trained context window is 1048K tokens.

Frequently asked questions

What GGUF models has SicariusSicariiStuff published?

171 models are listed here, mainly from the Llama, Impish and Qwen families. The most downloaded is Impish_LLAMA_4B_V2.

Which quants does SicariusSicariiStuff publish?

The most common are Q4_K_M (45 models), Q4_0 (45 models), Q5_K_M (42 models) and Q6_K (41 models).

Keep browsing