GGUF models by SicariusSicariiStuff
171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.
HE
Hebrew_Nemo
Hebrew · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
EX
Eximius_Persona_5B
Eximius · SicariusSicariiStuff
Params5.82B
Context128K
Smallest1.5 GB
LL
LLAMA-3_8B_Unaligned_Alpha_RP_Soup
Llama · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest6.0 GB
LL
Impish LLAMA 4B iMatrix
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest1.2 GB
PE
Persona_Maker_12B
Persona · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
2B
2B ad GGUFs
SicariusSicariiStuff
Params2.61B
Context8K
Q4_K_M1.7 GB
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Qwen3.5 0.8B Abliterated ARM
Qwen · SicariusSicariiStuff
Params752M
Context256K
Smallest0.5 GB
EX
Eximius_Persona_5B
Eximius · SicariusSicariiStuff
Params5.82B
Context128K
Q4_K_M3.6 GB
PR
ProdeusUnity ChronosRemix Gold 12B GGUFs
Prodeusunity · SicariusSicariiStuff
Params12.2B
Context1000K
Q4_K_M7.5 GB
ON
Oni Mitsubishi 12B iMatrix
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Smallest2.9 GB
ZI
Zion_Alpha
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Smallest1.6 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Q4_K_M4.7 GB
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Q4_K_M8.9 GB
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.1 GB
RA
X Ray_Alpha
Ray · SicariusSicariiStuff
Params3.88B
Context128K
Smallest2.4 GB
NA
Nano_Imp_1B
Nano · SicariusSicariiStuff
Params1.5B
Context128K
Smallest0.9 GB
ON
Oni_Mitsubishi_12B_EP01
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest3.0 GB
GE
Gemma 2 2B ArliAI RPMax v1.1 ARM
Gemma · SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.6 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest2.8 GB
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest1.9 GB
LL
Impish LLAMA 6.84B iMatrix
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Smallest1.6 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest4.7 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest3.3 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.8 GB
SA
SaisExperiments Evil Alpaca 3B L3.2 GGUFs
Saisexperiments · SicariusSicariiStuff
Params3.21B
Context128K
Q4_K_M2.0 GB
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest4.8 GB
LL
Impish LLAMA 4B HA NL
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.3 GB