GGUF models by kromquant

78 GGUF models quantized by kromquant on Hugging Face. Sizes run from 8.03B to 12B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
testing polar 002 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing soak 003 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing dire 002 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · kromquant
Params8.03B
Context16K
Smallest8.5 GB
GGUF
TE
testing stygian 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing quartz 003 GGUFs
Testing · kromquant
Params12B
Context4192K
Smallest12.7 GB
GGUF
TE
testing damp 005 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
WA
Wanton
Wanton · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing over 003 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
GGUF
JA
L3 8.9B Blackfall SummanusAra v0.1 Q8
Jamet · kromquant
Params8.9B
Context8K
Smallest9.5 GB
GGUF
AD
Adumbral
Adumbral · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
ME
Messianic
Messianic · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
EV
Eveningrain
Eveningrain · kromquant
Params12B
Context8K
Smallest12.7 GB
GGUF
TE
testing bite 002 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing pen 001 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
GGUF
PH
Phantasma
Phantasma · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
SP
Spectre
Spectre · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
GA
Galaxies
Galaxies · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing twilight 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing odious 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing subfusc 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing nimbus 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
ST
Stygian
Stygian · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
CO
Corrupted
Corrupted · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing dim 001 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SK
Skywalker
Skywalker · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
VE
Vexation
Vexation · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
AR
Arcticrust.Conc
Arcticrust · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
SK
Skywalker
Skywalker · kromquant
Params12B
Context4192K
Smallest12.7 GB
GGUF
TE
testing beast 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF

Keep browsing