GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Q4_K_M2.0 GB
ON
Oni Mitsubishi 12B ARM
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Smallest6.9 GB
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest3.3 GB
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest4.7 GB
AS
Assistant_Pepe_32B
Assistant · SicariusSicariiStuff
Params32.8B
Context40K
Smallest18.6 GB
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest8.2 GB
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.9 GB
LL
Impish LLAMA 4B ARM
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.6 GB
ZI
Zion Alpha Instruction Tuned SLERP
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Smallest3.2 GB
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest8.2 GB
LL
Llama3.2 3B ShiningValiant2
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest1.9 GB
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
SA
SaisExperiments Evil Alpaca 3B L3.2 iMatrix
Saisexperiments · SicariusSicariiStuff
Params3.21B
Context128K
Smallest0.9 GB
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest5.5 GB
LL
Impish LLAMA 6.84B ARM
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Smallest4.0 GB
QW
Boomer_Qwen_72B
Qwen · SicariusSicariiStuff
Params72.7B
Context32K
Q4_K_M47.4 GB
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
IN
invisietch_Atlantis v0.1 12B
Invisietch · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
GP
gpt oss 20b GGUF ReUpload
gpt-oss · SicariusSicariiStuff
Params20.9B
Context128K
Smallest12.1 GB
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.1 GB
LL
Impish LLAMA 4B ARM HA
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.8 GB
TE
TeeZee DarkSapling 7B v2.0 ARM
Teezee · SicariusSicariiStuff
Params7.24B
Context32K
Smallest4.1 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.2 GB
LL
Impish LLAMA 6.84B
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Q4_K_M4.2 GB
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest2.5 GB
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest4.6 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Smallest2.2 GB
2B
2B ad ARM
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.6 GB