Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
magnum v2 4b
Magnum · brittlewis12
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · InferenceIllusionist
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v4 27b
Magnum · ihpocksnet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MA
magnum v2 32b chatml
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MA
Magnum Instruct
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MA
Magnum Holland Sus Merge
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
magnum v4 123b i1
Magnum · mradermacher
Params123B
Context128K
Smallest26.0 GB
Tool use
MA
Magnum 12b v2.5 Kto
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
MS3.2 24B Magnum Diamond PaperWitch Heresy
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
Magnum Eleusis
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum 3b v1 i1
Magnum · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MA
magnum v4 12b
Magnum · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
MA
Magnum v4 Cydonia v1.2 22B
Magnum · knifeayumu
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
anthracite-org/magnum-v1-32b
Magnum · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MA
Magnum v4 Cydonia vXXX 22B
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum Instruct DPO
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MA
ML2 123B Magnum Diamond
Magnum · tachyphylaxis
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MA
Magnum v2 12b
Magnum · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
anthracite-org/magnum-v2.5-12b-kto
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum twilight 12b
Magnum · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
MA
Magnum 4B KTO experiment
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
Magnum_Lyra_Darkness_12B Heretic
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
L3.3 70B Magnum v4 SE Cirrus X1 ModelStock
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
MS3.1 24B Magnum Diamond
Magnum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
ParasiticRogue/Magnum-Instruct-DPO-12B
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum Madness 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
magnum v3 34b
Magnum · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MA
Anthracite Org Magnum v4 9b
Magnum · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
MA
anthracite-org/magnum-v2-12b
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
anthracite org.magnum v4 123b
Magnum · DevQuasar-4
Params123B
Context128K
Q4_K_M73.2 GB
Tool use

Keep browsing