GGUF models by SicariusSicariiStuff

171 GGUF models quantized by SicariusSicariiStuff on Hugging Face. Sizes run from 752M to 72.7B parameters. The longest trained context is 1048K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Hebrew_Nemo
Hebrew · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
EX
Eximius_Persona_5B
Eximius · SicariusSicariiStuff
Params5.82B
Context128K
Smallest1.5 GB
GGUF
LL
LLAMA-3_8B_Unaligned_Alpha_RP_Soup
Llama · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
Roleplay
QW
Impish_QWEN_14B 1M
Qwen · SicariusSicariiStuff
Params14.8B
Context986K
Smallest6.0 GB
GGUF
LL
Impish LLAMA 4B iMatrix
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest1.2 GB
GGUF
PE
Persona_Maker_12B
Persona · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
2B
2B ad GGUFs
SicariusSicariiStuff
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DU
Dusk_Rainbow
Dusk · SicariusSicariiStuff
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 0.8B Abliterated ARM
Qwen · SicariusSicariiStuff
Params752M
Context256K
Smallest0.5 GB
ReasoningTool use
EX
Eximius_Persona_5B
Eximius · SicariusSicariiStuff
Params5.82B
Context128K
Q4_K_M3.6 GB
GGUF
PR
ProdeusUnity ChronosRemix Gold 12B GGUFs
Prodeusunity · SicariusSicariiStuff
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ON
Oni Mitsubishi 12B iMatrix
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Smallest2.9 GB
GGUF
ZI
Zion_Alpha
Zion · SicariusSicariiStuff
Params7.24B
Context32K
Smallest1.6 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Q4_K_M4.7 GB
GGUF
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Smallest8.1 GB
GGUF
RA
X Ray_Alpha
Ray · SicariusSicariiStuff
Params3.88B
Context128K
Smallest2.4 GB
Vision
NA
Nano_Imp_1B
Nano · SicariusSicariiStuff
Params1.5B
Context128K
Smallest0.9 GB
GGUF
ON
Oni_Mitsubishi_12B_EP01
Oni · SicariusSicariiStuff
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest3.0 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1 ARM
Gemma · SicariusSicariiStuff
Params2.61B
Context8K
Smallest1.6 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest2.8 GB
GGUF
QW
Impish_QWEN_7B 1M
Qwen · SicariusSicariiStuff
Params7.62B
Context986K
Smallest1.9 GB
GGUF
LL
Impish LLAMA 6.84B iMatrix
Llama · SicariusSicariiStuff
Params6.84B
Context128K
Smallest1.6 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest4.7 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · SicariusSicariiStuff
Params8.03B
Context16K
Smallest3.3 GB
GGUF
LL
Impish_LLAMA_4B_Abliterated
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest2.8 GB
GGUF
SA
SaisExperiments Evil Alpaca 3B L3.2 GGUFs
Saisexperiments · SicariusSicariiStuff
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
AS
Assistant_Pepe_8B
Assistant · SicariusSicariiStuff
Params8.04B
Context1048K
Smallest4.8 GB
GGUF
LL
Impish LLAMA 4B HA NL
Llama · SicariusSicariiStuff
Params4.51B
Context128K
Smallest3.3 GB
GGUF

Keep browsing