GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 4B_Abliterated
Qwen · SicariusSicariiStuff
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest1.0 GB
GGUF
CA
CalderaAI_Foredoomed-9B
Calderaai · SicariusSicariiStuff
Params9.86B
Context32K
Q4_K_M5.9 GB
Tool use
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
2B
2B ad GGUF HA
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.3 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.0 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.9 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
QU
Question_Builder
Question · SicariusSicariiStuff
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
2B_or_not_2B
Not · SicariusSicariiStuff
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest3.0 GB
GGUF
AN
Angelic Eclipse 12B iMatrix
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest3.6 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
GGUF
RE
Redemption_Wind_24B
Redemption · SicariusSicariiStuff
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.5 2B_Abliterated
Qwen · SicariusSicariiStuff
Params1.88B
Context256K
Smallest1.2 GB
ReasoningTool use
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest2.0 GB
GGUF
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest3.3 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.5 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest1.6 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest3.0 GB
GGUF
LL
Impish LLAMA 4B GGUF HA
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.0 GB
GGUF
QW
Qwen3.5 4B_Abliterated
Qwen · SicariusSicariiStuff
Params4.21B
Context256K
Smallest2.5 GB
ReasoningTool use
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest3.3 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
TI
Tinybra 13B
Tinybra · SicariusSicariiStuff
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest6.7 GB
GGUF
PE
Persona_Maker_24B
Persona · SicariusSicariiStuff
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest2.0 GB
GGUF

Keep browsing