Magnum GGUF models
271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.
MA
Magnum Instruct
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum v2 123b
Magnum · mradermacher
Params123B
Context128K
Smallest45.2 GB
MA
Magnum 3b v1
Magnum · UUFO-Aigis
Params3.21B
Context128K
Q4_K_M2.0 GB
MA
magnum v2 4b
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
MA
magnum v4 12b
Magnum · bairimengxiangjia
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum HomieMaid DPO 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
alpindale/magnum-72b-v1
Magnum · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
MA
magnum v4 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
MN 12B Starcannon v3
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
MN Magnum v2.5 18.5B Kto Instruct
Magnum · mradermacher
Params18.5B
Context1000K
Q4_K_M11.2 GB
MA
Magnum v4 22b
Magnum · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum v4 Cydonia v1.3 22B i1
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum v4 Cydonia v1.3 22B 2
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum HomieMaid DPO 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum DareLinearAbliterated Instruct DPO i1
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
Magnum 1b v1
Magnum · UUFO-Aigis
Params1.5B
Context128K
Q4_K_M1.0 GB
MA
magnum v3 34b tokfix
Magnum · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
MA
L3.3 70B Magnum v4 SE Cirrus X1 SLERP
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Magnum v3 27b Kto
Magnum · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
MA
Magnum Instruct DPO 18B
Magnum · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
MA
Magnum DareLinearAbliterated Instruct DPO
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
Magnum Picaro 0.7 V3 12b Q8 0
Magnum · AliCat2
Params12.2B
Context1000K
Smallest13.0 GB
MA
Magnum Consolidatum v1 12b
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
Anthracite Org Magnum v4 22b
Magnum · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
MA
Anthracite Org Magnum v3 27b Kto
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
MA
magnum v4 22b
Magnum · QuantFactory
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum 12b v2
Magnum · SolidSnacke
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
magnum v4 27b
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
MA
magnum v4 123b heretic DE
Magnum · Frisch12
Params123B
Context128K
Q4_K_M73.2 GB