Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
magnum v2 32b i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MA
magnum-72b-v1
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnaraxy 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum Blackout Ataraxy 2 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum 1b v1 i1
Magnum · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
MA
magnum v2 4b
Magnum · anthracite-org
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
Magnum Instruct
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MA
L3.3 70B Magnum Nexus
Magnum · DS-Archive
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
Magnum Instruct DPO
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
magnum v2.5 12b kto
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum_Lyra_Darkness_12B Heretic
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
L3.3 70B Magnum v4 SE Cirrus X1 ModelStock
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
magnum v4 12b
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnum Backyard Party 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
magnum-72b-v1
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum Blackout
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
ML2 123B Magnum Diamond2 i1
Magnum · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
MA
Magnum Lyra Darkness 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnum 49B SFT
Magnum · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
MA
magnum twilight 12b i1
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
magnum v3 27b r1 i1
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
Reasoning
MA
Magnum 12b v2
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum v4 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
MA
MS3.2 24B Magnum Diamond
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
Magnum Lyra Darkness 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
magnum v2.5 12b kto i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v2 12b
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v3 34b tokfix i1
Magnum · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MA
L3.3 70B Magnum Nexus
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
Magnum v4 Cydonia v1.2 22B i1
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use

Keep browsing