Magnum GGUF models

271 GGUF models in the Magnum family, quantized by 49 uploaders. Sizes run from 1.5B to 123B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
magnum v4 123b
Magnum · mradermacher
Params123B
Context128K
Smallest45.2 GB
Tool use
MA
Magnum Picaro 0.7 V3 12b Q6 K
Magnum · Carnyzzle
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MA
Magnum Picaro 0.7 V3 12b Q5 K M
Magnum · Trappu
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
MA
anthracite-org/magnum-v1-72b
Magnum · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MA
Magnum v2 12b
Magnum · win10
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
MA
Magnum 49B SFT
Magnum · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
MA
Magnum 1b Creative Writing RP
Magnum · Novaciano
Params1.5B
Context128K
Smallest0.9 GB
Roleplay
MA
magnum twilight 12b
Magnum · l3utterfly
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MA
Magnum Eleucaro i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum 1b Aesir
Magnum · Novaciano
Params1.5B
Context128K
Smallest0.9 GB
Roleplay
MA
Magnum v4 Cydonia v1.3 22B Q4 K M
Magnum · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
Magnum v4 Cydonia vXXX 22B Q4 K M
Magnum · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
magnum 32b v1 Q6 K
Magnum · newsletter
Params32.5B
Context32K
Smallest26.7 GB
GGUF
MA
Magnum Dark Madness 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
Magnolia v1 12B
Magnum · grimjim
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
Magnum Madness 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MA
Magnum HomieMaid DPO 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MA
Anthracite Org Magnum v2 12b
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
MA
Magnum Blackout Ataraxy 5 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
MA
Magnum Dark Madness 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MA
magnum v3 9b chatml
Magnum · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
MA
amadeus
Magnum · kuuhaku06
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MA
Magnum Opus Galatea MN 12B Q6 K
Magnum · King-Cane
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MA
magnum v4 27b GGUF 0
Magnum · ThijsL202
Params27.2B
Context8K
Smallest28.9 GB
GGUF
MA
Magnum Backyard Party 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MA
ML2 123B Magnum Diamond Q4 K X
Magnum · Geechan
Params123B
Context128K
Smallest74.2 GB
GGUF
MA
magnum v3 27b r1 Q5 K M
Magnum · tofumagnate
Params27.2B
Context8K
Smallest19.4 GB
Reasoning
MA
magnum v3 27b kto r3 Q8 0
Magnum · ShotMisser64
Params27.2B
Context8K
Smallest28.9 GB
GGUF
MA
Magnum Eleusis i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing