GGUF models by Nekuromento
75 GGUF models quantized by Nekuromento on Hugging Face. Sizes run from 494M to 16B parameters. The longest trained context is 128K tokens.
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
LL
llama3 empower functions small v1.1 Q6 K
Llama · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
QW
SenecaLLM x Qwen2.5 7B CyberSecurity Q8 0
Qwen · Nekuromento
Params7.62B
Context32K
Smallest8.1 GB
HA
Hammer2.1 3b
Hammer · Nekuromento
Params3.09B
Context32K
Q4_K_M1.9 GB
GH
ghost coder 8b beta 1608 Q5 K M
Ghost · Nekuromento
Params8.03B
Context8K
Smallest5.7 GB
HA
Hammer2.0 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.3 GB
HA
Hammer2.1 3b
Hammer · Nekuromento
Params3.09B
Context32K
Smallest2.2 GB
GE
Gemma2 Nephilim v3 9B
Gemma · Nekuromento
Params9.24B
Context8K
Smallest6.6 GB
SE
Serpe 7B Q4 K M
Serpe · Nekuromento
Params7.62B
Context32K
Q4_K_M4.7 GB
FU
functionary v4r small preview Q6 K
Functionary · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
HA
Hammer 4b
Hammer · Nekuromento
Params3.95B
Context32K
Smallest4.2 GB
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
HA
Hammer2.1 0.5b
Hammer · Nekuromento
Params494M
Context32K
Smallest0.5 GB
HA
Hammer2.0 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest8.1 GB
AT
Athene Codegemma 2 7b It Alpaca v1
Athene · Nekuromento
Params8.54B
Context8K
Smallest7.0 GB
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
FU
functionary v4r small preview Q5 K M
Functionary · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Q4_K_M4.7 GB
HA
Hammer2.1 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.1 GB
FU
functionary v4r small preview Q8 0
Functionary · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
GH
Ghost 8b Beta 1608
Ghost · Nekuromento
Params8.03B
Context8K
Q4_K_M4.9 GB