Magnum GGUF models
271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.
MA
Magnum Instruct DPO
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Anthracite Org_Magnum v2 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
Trappu Magnum Picaro 0.7 v2 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum Picaro 0.7 v2 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
Magnum v3 27b Kto
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
MS3.2 24B Magnum Diamond
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
Magnum v4 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
L3.3 70B Magnum v4 SE
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
ML2 123B Magnum Diamond
Magnum · Doctor-Shotgun
Params123B
Context128K
Q4_K_M73.2 GB
MA
magnum v2 12b
Magnum · anthracite-org
Params12.2B
Context1000K
Smallest5.7 GB
MA
Magnum v4 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
L3.3 70B Magnum Nexus
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
magnum 32b v2 i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MA
magnum v3 9b chatml
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MA
magnum 32b v1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MA
Magnum Blackout i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum 32b v1
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
MA
L3.3 70B Magnum v5 SFT Alpha
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
MN Magnum v2.5 18.5B Kto Instruct
Magnum · bartowski
Params18.5B
Context1000K
Q4_K_M11.2 GB
MA
Magnum v2 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
magnum v2 4b i1
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
MA
magnum v4 27b i1
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
MA
magnum v4 9b
Magnum · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum v1 32b
Magnum · anthracite-org
Params32.5B
Context32K
Smallest10.3 GB
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
magnum v3 34b i1
Magnum · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB