GGUF models by kromquant
78 GGUF models quantized by kromquant on Hugging Face. Sizes run from 8.03B to 12B parameters. The longest trained context is 4192K tokens.
TE
testing polar 002 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
TE
testing soak 003 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
TE
testing dire 002 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · kromquant
Params8.03B
Context16K
Smallest8.5 GB
TE
testing stygian 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing quartz 003 GGUFs
Testing · kromquant
Params12B
Context4192K
Smallest12.7 GB
TE
testing damp 005 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
WA
Wanton
Wanton · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing over 003 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
JA
L3 8.9B Blackfall SummanusAra v0.1 Q8
Jamet · kromquant
Params8.9B
Context8K
Smallest9.5 GB
AD
Adumbral
Adumbral · kromquant
Params12B
Context128K
Smallest12.7 GB
ME
Messianic
Messianic · kromquant
Params12B
Context128K
Smallest12.7 GB
EV
Eveningrain
Eveningrain · kromquant
Params12B
Context8K
Smallest12.7 GB
TE
testing bite 002 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
TE
testing pen 001 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
PH
Phantasma
Phantasma · kromquant
Params12B
Context128K
Smallest12.7 GB
SP
Spectre
Spectre · kromquant
Params12B
Context128K
Smallest12.7 GB
GA
Galaxies
Galaxies · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing twilight 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing odious 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing subfusc 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing nimbus 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
ST
Stygian
Stygian · kromquant
Params12B
Context128K
Smallest12.7 GB
CO
Corrupted
Corrupted · kromquant
Params12B
Context128K
Smallest12.7 GB
TE
testing dim 001 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
SK
Skywalker
Skywalker · kromquant
Params12B
Context128K
Smallest12.7 GB
VE
Vexation
Vexation · kromquant
Params12B
Context128K
Smallest12.7 GB
AR
Arcticrust.Conc
Arcticrust · kromquant
Params12B
Context128K
Smallest12.7 GB
SK
Skywalker
Skywalker · kromquant
Params12B
Context4192K
Smallest12.7 GB
TE
testing beast 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB