GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
About SicariusSicariiStuff on Hugging Face
SicariusSicariiStuff has published 171 GGUF models that ggufmodels.com tracks, across families such as Llama, Impish and Qwen. The most downloaded are Impish_LLAMA_4B_V2, Impish_Bloodmoon_12B and Impish_QWEN_14B 1M.
The quants SicariusSicariiStuff publishes most often are Q4_K_M (45), Q4_0 (45), Q5_K_M (42) and Q6_K (41). Their Q4_K_M files range from 0.5 to 47.4 GB. Parameter counts run from 752M to 72.7B, and the longest trained context window is 1048K tokens.
Frequently asked questions
What GGUF models has SicariusSicariiStuff published?
171 models are listed here, mainly from the Llama, Impish and Qwen families. The most downloaded is Impish_LLAMA_4B_V2.
Which quants does SicariusSicariiStuff publish?
The most common are Q4_K_M (45 models), Q4_0 (45 models), Q5_K_M (42 models) and Q6_K (41 models).