GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.9 GB
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.4 GB
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
BE
concedo_Beepo 22B
Beepo · SicariusSicariiStuff
Params22.2B
Context32K
Smallest12.6 GB
IM
Impish Magic 24B ARM
Impish · SicariusSicariiStuff
Params23.6B
Context40K
Smallest13.4 GB
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest9.0 GB
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.3 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest4.4 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.6 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest6.8 GB
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest8.4 GB
PE
Persona_Maker_12B
Persona · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.0 GB
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest5.2 GB
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest4.9 GB
2B
2B ad ARM HA
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.8 GB
RE
Redemption_Wind_24B
Redemption · SicariusSicariiStuff
Params23.6B
Context32K
Smallest13.4 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest7.2 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest7.8 GB
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.6 GB