GGUF models by kromquant

78 GGUF models quantized by kromquant on Hugging Face. Sizes run from 8.03B to 12B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Milkyway
Milkyway · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
OD
Odious
Odious · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing tan 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing eve 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing vim 004 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing tact 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing hip 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MA
Mantle
Mantle · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
SU
Subfusc
Subfusc · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing page 001 GGUFs
Testing · kromquant
Params8.03B
Context1048K
Smallest8.5 GB
GGUF
TE
testing wet 006 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing lot 002 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TW
Twilight
Twilight · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
SP
Spectre
Spectre · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
BE
Beasts
Beasts · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing bronze 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing chill 003 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SA
Sallow
Sallow · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF

Keep browsing