GGUF models by Vortex5
67 GGUF models quantized by Vortex5 on Hugging Face. Sizes run from 12.2B to 23.6B parameters. The longest trained context is 1000K tokens.
About Vortex5 on Hugging Face
Vortex5 has published 67 GGUF models that ggufmodels.com tracks, across families such as Mystic, Scarlet and Moonlit. The most downloaded are Moonbright 12B, Chaos Unknown 12b and MN 12B Azure Veil.
The quants Vortex5 publishes most often are Q6_K (44), Q4_K_M (22) and Q5_K_S (1). Their Q4_K_M files range from 7.5 to 14.3 GB. Parameter counts run from 12.2B to 23.6B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has Vortex5 published?
67 models are listed here, mainly from the Mystic, Scarlet and Moonlit families. The most downloaded is Moonbright 12B.
Which quants does Vortex5 publish?
The most common are Q6_K (44 models), Q4_K_M (22 models) and Q5_K_S (1 models).