GGUF models by Vortex5

67 GGUF models quantized by Vortex5 on Hugging Face. Sizes run from 12.2B to 23.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MO
Moonbright 12B
Moonbright · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CH
Chaos Unknown 12b
Chaos · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
AZ
MN 12B Azure Veil
Azure · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
DR
Drifting Shadow 12B
Drifting · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
HA
Harmonic Moon 12B
Harmonic · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CR
MN 14B Crimson Veil
Crimson · Vortex5
Params13.6B
Context1000K
Smallest9.5 GB
Roleplay
LU
Lunar Nexus 12B
Lunar · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PR
Prototype X 12b
Prototype · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MO
Moonlit Shadow 12B
Moonlit · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
HA
Harmony Bird 12B
Harmony · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
HO
Hollowed Rose 12B
Hollowed · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
CH
MS3.2 24B Chaos Skies
Chaos · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MY
MN Mystic Rune 12B
Mystic · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MO
Moondark 12B
Moondark · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FA
Fallen Skies 12B
Fallen · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
SC
Scarlet Seraph 12B
Scarlet · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
VE
Vermilion Sage 12B
Vermilion · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MO
Moonlit Shadow 12B
Moonlit · Vortex5
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
ST
Starry Shadow 12B
Starry · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
DA
Dark Quill 12B
Dark · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
CH
ChaosFlowerRP 24B
Chaosflowerrp · Vortex5
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
RE
Red Synthesis 12B
Red · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
LU
Lunar Nexus 12B
Lunar · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
VE
Velvet Orchid 12B
Velvet · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
Roleplay
SU
Sunlit Shadow 12B
Sunlit · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
ST
Starlit Shadow 12B
Starlit · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
DR
Dreamstar 12B
Dreamstar · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MY
Mystic Rune v2 12B
Mystic · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RA
Radiant Shadow 12B
Radiant · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RA
Radiant Shadow 12B
Radiant · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF

About Vortex5 on Hugging Face

Vortex5 has published 67 GGUF models that ggufmodels.com tracks, across families such as Mystic, Scarlet and Moonlit. The most downloaded are Moonbright 12B, Chaos Unknown 12b and MN 12B Azure Veil.

The quants Vortex5 publishes most often are Q6_K (44), Q4_K_M (22) and Q5_K_S (1). Their Q4_K_M files range from 7.5 to 14.3 GB. Parameter counts run from 12.2B to 23.6B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has Vortex5 published?

67 models are listed here, mainly from the Mystic, Scarlet and Moonlit families. The most downloaded is Moonbright 12B.

Which quants does Vortex5 publish?

The most common are Q6_K (44 models), Q4_K_M (22 models) and Q5_K_S (1 models).

Keep browsing