GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
QW
Qwen3.5 4B_Abliterated
Qwen · SicariusSicariiStuff
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest1.0 GB
CA
CalderaAI_Foredoomed-9B
Calderaai · SicariusSicariiStuff
Params9.86B
Context32K
Q4_K_M5.9 GB
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Q4_K_M4.9 GB
2B
2B ad GGUF HA
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.3 GB
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.0 GB
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.9 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Q4_K_M4.9 GB
QU
Question_Builder
Question · SicariusSicariiStuff
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
2B_or_not_2B
Not · SicariusSicariiStuff
Params2.51B
Context8K
Q4_K_M1.6 GB
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest3.0 GB
AN
Angelic Eclipse 12B iMatrix
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest3.6 GB
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
RE
Redemption_Wind_24B
Redemption · SicariusSicariiStuff
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3.5 2B_Abliterated
Qwen · SicariusSicariiStuff
Params1.88B
Context256K
Smallest1.2 GB
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest2.0 GB
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest3.3 GB
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.5 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest1.6 GB
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest3.0 GB
LL
Impish LLAMA 4B GGUF HA
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.0 GB
QW
Qwen3.5 4B_Abliterated
Qwen · SicariusSicariiStuff
Params4.21B
Context256K
Smallest2.5 GB
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest3.3 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Q4_K_M2.2 GB
TI
Tinybra 13B
Tinybra · SicariusSicariiStuff
Params13B
Context16K
Q4_K_M7.9 GB
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest6.7 GB
PE
Persona_Maker_24B
Persona · SicariusSicariiStuff
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest2.0 GB