GGUF models by Vortex5
67 GGUF models quantized by Vortex5 on Hugging Face. Sizes run from 12.2B to 23.6B parameters. The longest trained context is 1000K tokens.
CR
Crimson Twilight 12B
Crimson · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
CH
MS3.2 24B Chaos Mirage Nearswap
Chaos · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
LU
Luminous Shadow 12B
Luminous · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
NO
Noir Blossom 12B
Noir · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
MO
Moonviolet 12B
Moonviolet · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
SH
Shadow Crystal 12B
Shadow · Vortex5
Params12.2B
Context128K
Q4_K_M7.5 GB
WI
WittyAthena 24b
Wittyathena · Vortex5
Params23.6B
Context32K
Q4_K_M14.3 GB