Magnum GGUF models
271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.
MA
magnum v4 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MA
Magnum v4 Cydonia v1.3 22B 2 i1
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum Opus 35B A3B
Magnum · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MA
MS3.1 24B Magnum Diamond
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
magnum 32b v2
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MA
Magnum v3 27b Kto
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
MA
magnum v3 9b customgemma2 i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
Magnum 12b v2.5 Kto
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum v2 123b
Magnum · mradermacher
Params123B
Context128K
Smallest26.0 GB
MA
magnum v3 9b chatml i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
L3.3 70B Magnum v4 SE
Magnum · DS-Archive
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Magnum Picaro 0.7 V3 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
magnum v3 34b
Magnum · anthracite-org
Params34.4B
Context32K
Q4_K_M20.7 GB
MA
Magnum 12b v2
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
magnum twilight 12b
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
Magnum v4 9b Abliterated
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
Magnum v4 12B Heretic
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum V4 72B
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
Magnum Blackout Ataraxy 3 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum v4 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
L3.3 70B Magnum v5 SFT Alpha
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
magnum v2 32b chatml i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MA
L3.3 70B Magnum Diamond
Magnum · Doctor-Shotgun
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
magnum v4 123b
Magnum · anthracite-org
Params123B
Context128K
Q4_K_M73.2 GB
MA
magnum v2 32b
Magnum · anthracite-org
Params32.5B
Context32K
Smallest14.7 GB
MA
MS3.1 24B Magnum Diamond
Magnum · DS-Archive
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
MS3.2 24B Magnum Diamond PaperWitch Heresy
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
L3.3 70B Magnum Diamond
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Magnum Opus 35B A3B
Magnum · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MA
magnum v2 32b
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB