GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.9 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.4 GB
GGUF
AN
Angelic_Eclipse_12B
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
GGUF
BE
concedo_Beepo 22B
Beepo · SicariusSicariiStuff
Params22.2B
Context32K
Smallest12.6 GB
Tool use
IM
Impish Magic 24B ARM
Impish · SicariusSicariiStuff
Params23.6B
Context40K
Smallest13.4 GB
GGUF
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest9.0 GB
GGUF
IM
Impish_Nemo_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.3 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest4.4 GB
GGUF
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.6 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest6.8 GB
GGUF
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PE
Persona_Maker_12B
Persona · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
GGUF
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.0 GB
GGUF
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest5.2 GB
GGUF
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest4.9 GB
GGUF
2B
2B ad ARM HA
SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.8 GB
GGUF
RE
Redemption_Wind_24B
Redemption · SicariusSicariiStuff
Params23.6B
Context32K
Smallest13.4 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest7.2 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest7.8 GB
GGUF
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.6 GB
GGUF

Keep browsing