GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
HE
Hebrew_Nemo
Hebrew · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
QW
Qwen2.5 7B
Qwen · SicariusSicariiStuff
Params7.62B
Context128K
Smallest4.4 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest4.7 GB
MI
MiS Firefly v0.2 22B
Mis · SicariusSicariiStuff
Params22.2B
Context32K
Smallest12.6 GB
TE
Tenebra
Tenebra · SicariusSicariiStuff
Params32.5B
Context2K
Smallest13.5 GB
LL
Llama 3.3 8B Instruct 128K Abliterated ARM
Llama · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.7 GB
TI
Tinybra_13B
Tinybra · SicariusSicariiStuff
Params13B
Context16K
Smallest7.4 GB
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.4 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest5.5 GB
2B
2B ad HA NL
SicariusSicariiStuff
Params2.61B
Context8K
Smallest2.4 GB
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest5.5 GB
IM
Impish_Longtail_12B
Impish · SicariusSicariiStuff
Params12.2B
Context1000K
Smallest7.1 GB
LL
Impish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.21B
Context128K
Smallest2.1 GB
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest8.5 GB
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest4.7 GB
IM
Impish_Mind_8B
Impish · SicariusSicariiStuff
Params8.03B
Context128K
Smallest4.9 GB
TE
Tenebra 30B ARM
Tenebra · SicariusSicariiStuff
Params32.5B
Context16K
Smallest18.4 GB
WI
Wingless_Imp_8B
Wingless · SicariusSicariiStuff
Params8.03B
Context128K
Smallest5.5 GB
AN
Angelic Eclipse 12B ARM
Angelic · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.7 GB
PE
Persona_Maker_24B
Persona · SicariusSicariiStuff
Params23.6B
Context128K
Smallest13.4 GB
SW
Sweet_Dreams_12B
Sweet · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.1 GB
MI
Mistral Nemo Instruct 2407 ARM HA Q5
Mistral · SicariusSicariiStuff
Params12.2B
Context128K
Smallest7.4 GB
RE
ResplendentAI Nymph 8B ARM
Resplendentai · SicariusSicariiStuff
Params8.03B
Context8K
Smallest4.7 GB
LL
Fiendish_LLAMA_3B
Llama · SicariusSicariiStuff
Params3.61B
Context128K
Smallest2.1 GB
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Smallest5.5 GB
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest5.8 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest4.9 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest5.2 GB