GGUF models by Nekuromento

75 GGUF models quantized by Nekuromento on Hugging Face. Sizes run from 494M to 16B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
Tool use
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
Coding
LL
llama3 empower functions small v1.1 Q6 K
Llama · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
Tool use
QW
SenecaLLM x Qwen2.5 7B CyberSecurity Q8 0
Qwen · Nekuromento
Params7.62B
Context32K
Smallest8.1 GB
Tool use
HA
Hammer2.1 3b
Hammer · Nekuromento
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
GH
ghost coder 8b beta 1608 Q5 K M
Ghost · Nekuromento
Params8.03B
Context8K
Smallest5.7 GB
CodingTool use
HA
Hammer2.0 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.3 GB
Tool use
HA
Hammer2.1 3b
Hammer · Nekuromento
Params3.09B
Context32K
Smallest2.2 GB
Tool use
GE
Gemma2 Nephilim v3 9B
Gemma · Nekuromento
Params9.24B
Context8K
Smallest6.6 GB
GGUF
SE
Serpe 7B Q4 K M
Serpe · Nekuromento
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
FU
functionary v4r small preview Q6 K
Functionary · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
Tool use
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
Tool use
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
Tool use
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
Tool use
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
Tool use
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
Tool use
HA
Hammer 4b
Hammer · Nekuromento
Params3.95B
Context32K
Smallest4.2 GB
Tool use
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
HA
Hammer2.1 0.5b
Hammer · Nekuromento
Params494M
Context32K
Smallest0.5 GB
Tool use
HA
Hammer2.0 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
Tool use
HA
Hammer2.1 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest8.1 GB
Tool use
AT
Athene Codegemma 2 7b It Alpaca v1
Athene · Nekuromento
Params8.54B
Context8K
Smallest7.0 GB
GGUF
WA
Watt Tool 8B
Watt · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
Coding
FU
functionary v4r small preview Q5 K M
Functionary · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
Tool use
TO
ToolACE 8B
Toolace · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
Coding
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
HA
Hammer2.1 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.1 GB
Tool use
FU
functionary v4r small preview Q8 0
Functionary · Nekuromento
Params8.03B
Context128K
Smallest8.5 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · Nekuromento
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use

Keep browsing