Mamba GGUF models

90 GGUF models in the Mamba family, quantized by 25 uploaders. Sizes run from 129M to 7.27B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
mamba-130m
Mamba · RichardErkhov
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
MA
mamba-370m-hf
Mamba · RichardErkhov
Params372M
Context1024K
Q4_K_M0.3 GB
GGUF
MA
mamba-2.8b-hf
Mamba · RichardErkhov
Params2.77B
Context1024K
Q4_K_M2.0 GB
GGUF
MA
Mamba 370M
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
GGUF
MA
Mamba 1B
Mamba · mradermacher
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
MA
Mamba Ko 2.8b
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
mamba-2.8b-hf
Mamba · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
GGUF
MA
mamba 370m msmath
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
GGUF
MA
Mamba 2.8b Zephyr Hf
Mamba · RichardErkhov
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
Mamba Ko 2.8b
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
Mamba Gpt 7b v2
Mamba · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
mamba-790m-hf
Mamba · RichardErkhov
Params793M
Context1024K
Q4_K_M0.6 GB
GGUF
MA
mamba 2.8b flamethrower trained
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
Mamba 1B
Mamba · mradermacher
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
MA
Mamba 130M
Mamba · mradermacher
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
MA
Mamba 2.8b Zephyr Hf
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
Mamba 2.8b Instruct
Mamba · ansh0x
Params2.77B
Context1024K
Smallest1.9 GB
Tool use
MA
State Spaces Mamba 130m Hf
Mamba · tensorblock
Params129M
Context1024K
Smallest0.1 GB
GGUF
MA
Mamba 2.8b Ultrachat Hf
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
mamba-1.4b-hf
Mamba · RichardErkhov
Params1.37B
Context1024K
Q4_K_M1.0 GB
GGUF
MA
Mamba 3B Slimpj
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MA
Mamba 1.4b Hf
Mamba · RichardErkhov
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
MA
State Spaces Mamba 1.4b Hf
Mamba · tensorblock
Params1.37B
Context1024K
Smallest0.5 GB
GGUF
MA
mamba gpt 7b
Mamba · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
mamba 765M chinese chat v0.1
Mamba · mradermacher
Params765M
Context1024K
Q4_K_M0.5 GB
GGUF
MA
mamba gpt 7b
Mamba · gultar
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
mamba gpt 3b v4
Mamba · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
MA
Mamba 1.4b
Mamba · RichardErkhov
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
MA
Mamba 1.4b Hf
Mamba · mradermacher
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
MA
State Spaces Mamba 2.8b Hf
Mamba · tensorblock
Params2.77B
Context1024K
Smallest1.0 GB
GGUF

Keep browsing