Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
Magnum Pygmalion
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum-72b-v1
Magnum · alpindale
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum 1b Erotiquant3 IQ4 XS
Magnum · Novaciano
Params1.5B
Context128K
Smallest0.9 GB
Roleplay
MA
magnum 32b v2 Q4 K M
Magnum · SmileyTatsu
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MA
ML2 123B Magnum Diamond2
Magnum · mradermacher
Params123B
Context128K
Smallest45.2 GB
GGUF
MA
Magnum v4 9b
Magnum · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum v2 72b
Magnum · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum 1b Short Stories Q5 K S
Magnum · Novaciano
Params1.5B
Context128K
Smallest1.1 GB
GGUF
MA
Magnum v4 22b
Magnum · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
MS3.2 24B Magnum Diamond
Magnum · puffyclouder
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
Magnum Blackout Ataraxy 4 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum 1b Short Stories Q4 K M
Magnum · Novaciano
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
MA
Magnum Picaro 0.7 v2 12b Q8 0
Magnum · netnk9151
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
MA
ML2 123B Magnum Diamond
Magnum · mradermacher
Params123B
Context128K
Smallest45.2 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MA
Magnum 1b Short Stories Q5 K M
Magnum · Novaciano
Params1.5B
Context128K
Smallest1.1 GB
GGUF
MA
Magnum 1b Short Stories IQ4 XS
Magnum · Novaciano
Params1.5B
Context128K
Smallest0.9 GB
GGUF
MA
Magnum Pygmalion i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum Backyard Party 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
magnum v2.5 12b kto
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
MA
MN Magnum v2.5 18.5B Kto Instruct
Magnum · mradermacher
Params18.5B
Context1000K
Q4_K_M11.2 GB
GGUF
MA
Magnum v4 Cydonia v1.2 22B
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum v2 123b
Magnum · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MA
Magnum v4 Cydonia v1.3 22B
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
magnum v2.5 12b kto
Magnum · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum 12b v2
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
MA
magnum v4 123b jp imatrix
Magnum · midoriinko
Params123B
Context128K
Smallest47.0 GB
Tool use
MA
Magnum Picaro 0.7 V3 12b Q4 K S
Magnum · Trappu
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
MA
Magnum Eleucaro
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum 1b Erotiquant3 Q5 K M
Magnum · Novaciano
Params1.5B
Context128K
Smallest1.1 GB
Roleplay

Keep browsing