Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
magnum-72b-v1
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum Nemo Unleashed
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum v2 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum v2 12b
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Doctor Shotgun.L3.3 70B Magnum Nexus
Magnum · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
Magnum 3b v1
Magnum · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MA
Magnum Dark Madness 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnum Consolidatum v1 12b
Magnum · RichardErkhov
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Magnum Nemo Unleashed
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v2.5 12b kto
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Trappu/Magnum-Picaro-0.7-v2-12b
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum v4 12B Heretic
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v2 123b
Magnum · anthracite-org
Params123B
Context128K
Smallest26.0 GB
GGUF
MA
L3.3 70B Magnum v4 SE
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
MA
magnum v3 9b customgemma2
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum Instruct DPO 18B
Magnum · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
RoleplayTool use
MA
magnum v2 4b gguf lowctx
Magnum · adamo1139
Params4.51B
Context8K
Q4_K_M2.8 GB
GGUF
MA
Doctor Shotgun.MS3.2 24B Magnum Diamond
Magnum · DevQuasar
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
Magnum 4B KTO experiment i1
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
ML2 123B Magnum Diamond i1
Magnum · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
MA
Magnum 1b v1
Magnum · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
MA
Magnum v4 Cydonia vXXX 22B i1
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum Consolidatum v1 12b
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Naphula__magnum v4 9b Abliterated
Magnum · Naphula
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum Picaro 0.7 V3 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum Instruct DPO
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MA
L3.3 70B Magnum v5 SFT Alpha
Magnum · DS-Archive
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
Magnum Madness 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
L3.3 70B Magnum Diamond
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
magnum v3 27b r1
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
Reasoning

Keep browsing