GGUF models by Vortex5

67 GGUF models quantized by Vortex5 on Hugging Face. Sizes run from 12.2B to 23.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
PO
Poetic Nexus 12B
Poetic · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
ST
Stellar Umbra 12B
Stellar · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
SC
Scarlet Eclipse 12B
Scarlet · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
ME
MegaMoon Karcher 12B
Megamoon · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
CR
Crystal Moon 12B
Crystal · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
PO
Poetic Rune 12B
Poetic · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
VI
Violet Mist 12B
Violet · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MY
Mystic Matron 12B
Mystic · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
NO
NovaSage 24B
Novasage · Vortex5
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MY
MN Mystic Rune 12B
Mystic · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Midnight Ocean 12B
Midnight · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
SO
MS3.2 24B Solar Skies
Solar · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
NO
NoctyxCosma 12B
Noctyxcosma · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
SC
Scarlet Ink 12B
Scarlet · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
HO
Hollow Aether 12B
Hollow · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MO
Moonlit Umbra 12B
Moonlit · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
AB
Abyssal Seraph 12B
Abyssal · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
LU
Lunar Abyss 12B
Lunar · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
FO
Forsaken Void 12B
Forsaken · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
ST
MS3.2 24B Stellar Skies
Stellar · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
FI
MS3.2 24B Fiery Lynx
Fiery · Vortex5
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LU
LunaMaid 12B
Lunamaid · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
Roleplay
MY
Mystic Rune v2 12B
Mystic · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
SH
Shadow Crystal 12B
Shadow · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
HA
Harmonic Lumina 12B
Harmonic · Vortex5
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MO
MoonMega 12B
Moonmega · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CR
Crystal Ocean 12B
Crystal · Vortex5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HA
Harmonic Moon 12B
Harmonic · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
VO
VoidRose 24B
Voidrose · Vortex5
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
CR
Crystal Moon 12B
Crystal · Vortex5
Params12.2B
Context1000K
Smallest10.1 GB
GGUF

Keep browsing