GGUF models by Vortex5

67 GGUF models quantized by Vortex5 on Hugging Face. Sizes run from 12.2B to 23.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CR
Crimson Twilight 12B
Crimson · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
CH
MS3.2 24B Chaos Mirage Nearswap
Chaos · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LU
Luminous Shadow 12B
Luminous · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
NO
Noir Blossom 12B
Noir · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MO
Moonviolet 12B
Moonviolet · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SH
Shadow Crystal 12B
Shadow · Vortex5
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
WI
WittyAthena 24b
Wittyathena · Vortex5
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay

Keep browsing