GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ON
Oni Mitsubishi 12B ARM
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Smallest6.9 GB
GGUF
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest3.3 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
Tool use
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest4.7 GB
GGUF
AS
Assistant_Pepe_32B
Assistant · SicariusSicariiStuff
Params32.8B
Context40K
Smallest18.6 GB
GGUF
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest8.2 GB
GGUF
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.9 GB
GGUF
LL
Impish LLAMA 4B ARM
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.6 GB
GGUF
ZI
Zion Alpha Instruction Tuned SLERP
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Smallest3.2 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest8.2 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.9 GB
Tool use
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
GGUF
SA
SaisExperiments Evil Alpaca 3B L3.2 iMatrix
Saisexperiments · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
Tool use
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest5.5 GB
GGUF
LL
Impish LLAMA 6.84B ARM
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Smallest4.0 GB
GGUF
QW
Boomer_Qwen_72B
Qwen · SicariusSicariiStuff
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
GGUF
IN
invisietch_Atlantis v0.1 12B
Invisietch · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
GP
gpt oss 20b GGUF ReUpload
gpt-oss · SicariusSicariiStuff
Params20.9B
Context128K
Smallest12.1 GB
Tool use
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.1 GB
GGUF
LL
Impish LLAMA 4B ARM HA
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.8 GB
GGUF
TE
TeeZee DarkSapling 7B v2.0 ARM
Teezee · SicariusSicariiStuff
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.2 GB
GGUF
LL
Impish LLAMA 6.84B
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Q4_K_M4.2 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest2.5 GB
GGUF
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest4.6 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Smallest2.2 GB
GGUF
2B
2B ad ARM
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.6 GB
GGUF

Keep browsing