Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
Magnum Instruct
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum v2 123b
Magnum · mradermacher
Params123B
Context128K
Smallest45.2 GB
GGUF
MA
Magnum 3b v1
Magnum · UUFO-Aigis
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MA
magnum v2 4b
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
magnum v4 12b
Magnum · bairimengxiangjia
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnum HomieMaid DPO 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
alpindale/magnum-72b-v1
Magnum · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
MA
magnum v4 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
MN 12B Starcannon v3
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
MN Magnum v2.5 18.5B Kto Instruct
Magnum · mradermacher
Params18.5B
Context1000K
Q4_K_M11.2 GB
GGUF
MA
Magnum v4 22b
Magnum · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum v4 Cydonia v1.3 22B i1
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum v4 Cydonia v1.3 22B 2
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum HomieMaid DPO 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnum DareLinearAbliterated Instruct DPO i1
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Magnum 1b v1
Magnum · UUFO-Aigis
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
MA
magnum v3 34b tokfix
Magnum · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MA
L3.3 70B Magnum v4 SE Cirrus X1 SLERP
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
Magnum v3 27b Kto
Magnum · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MA
Magnum Instruct DPO 18B
Magnum · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
RoleplayTool use
MA
Magnum DareLinearAbliterated Instruct DPO
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Magnum Picaro 0.7 V3 12b Q8 0
Magnum · AliCat2
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
MA
Magnum Consolidatum v1 12b
Magnum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Anthracite Org Magnum v4 22b
Magnum · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
Tool use
MA
Anthracite Org Magnum v3 27b Kto
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
MA
magnum v4 22b
Magnum · QuantFactory
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum 12b v2
Magnum · SolidSnacke
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v4 27b
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
MA
magnum v4 123b heretic DE
Magnum · Frisch12
Params123B
Context128K
Q4_K_M73.2 GB
Tool use

Keep browsing