GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Hebrew_Nemo
Hebrew · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
GGUF
QW
Qwen2.5 7B
Qwen · SicariusSicariiStuff
Params7.62B
Context128K
Smallest4.4 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest4.7 GB
GGUF
MI
MiS Firefly v0.2 22B
Mis · SicariusSicariiStuff
Params22.2B
Context32K
Smallest12.6 GB
GGUF
TE
Tenebra
Tenebra · SicariusSicariiStuff
Params32.5B
Context2K
Smallest13.5 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Abliterated ARM
Llama · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
Tool use
TI
Tinybra_13B
Tinybra · SicariusSicariiStuff
Params13B
Context16K
Smallest7.4 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
GGUF
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.4 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest5.5 GB
GGUF
2B
2B ad HA NL
SicariusSicariiStuff
Params2.61B
Context8K
Smallest2.4 GB
GGUF
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest5.5 GB
GGUF
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest2.1 GB
GGUF
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest8.5 GB
GGUF
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest4.7 GB
GGUF
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.9 GB
GGUF
TE
Tenebra 30B ARM
Tenebra · SicariusSicariiStuff
Params32.5B
Context16K
Smallest18.4 GB
GGUF
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest5.5 GB
GGUF
AN
Angelic Eclipse 12B ARM
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.7 GB
GGUF
PE
Persona_Maker_24B
Persona · SicariusSicariiStuff
Params23.6B
Context128K
Smallest13.4 GB
GGUF
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
GGUF
MI
Mistral Nemo Instruct 2407 ARM HA Q5
Mistral · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
Tool use
RE
ResplendentAI Nymph 8B ARM
Resplendentai · SicariusSicariiStuff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.1 GB
GGUF
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest5.5 GB
GGUF
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest5.8 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest4.9 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest5.2 GB
GGUF

Keep browsing