GGUF models by kromquant

78 GGUF models quantized by kromquant on Hugging Face. Sizes run from 8.03B to 12B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
CL
L3.1 Clouded Uchtave v0.1 8B GGUFs
Clouded · kromquant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AG
L3.1 Aglow Vulca v0.1 8B GGUFs
Aglow · kromquant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LA
Lacteous
Lacteous · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
SI
L3.1 Siithamo v0.2b 8B Q8
Siithamo · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing punica 001 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest8.3 GB
GGUF
CA
Carnal
Carnal · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing grey 001 GGUFs
Testing · kromquant
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SU
Succored
Succored · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing blues 002 GGUFs
Testing · kromquant
Params8.03B
Context16K
Smallest8.5 GB
GGUF
TE
testing draft 001 GGUFs
Testing · kromquant
Params12B
Context1048K
Smallest12.7 GB
GGUF
IN
Inclement
Inclement · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
ST
Starcollapse.Conc
Starcollapse · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TI
L3.1 Tivir 10B GGUFs
Tivir · kromquant
Params10.6B
Context128K
Q4_K_M6.5 GB
GGUF
SI
L3.1 Siithamo v0.3 8B GGUFs
Siithamo · kromquant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
testing silverline.conc 005 GGUFs
Testing · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
LI
Liquidate
Liquidate · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
HA
Haggard
Haggard · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
AB
L3.1 Ablaze Vulca v0.1c 8B GGUFs
Ablaze · kromquant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
testing hot 005 GGUFs
Testing · kromquant
Params8.03B
Context16K
Smallest8.5 GB
GGUF
SI
L3.1 Siithamo v0.4 8B GGUFs
Siithamo · kromquant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SI
L3.1 Siithamo v0.1 8B Q8
Siithamo · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
testing print 001 GGUFs
Testing · kromquant
Params12B
Context8K
Smallest12.7 GB
GGUF
SA
Saturnine
Saturnine · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing calm 001 GGUFs
Testing · kromquant
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NO
Novella
Novella · kromquant
Params12B
Context1048K
Smallest12.7 GB
GGUF
NI
Nimbus
Nimbus · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
BO
Boreal
Boreal · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
TE
testing blurs 002 GGUFs
Testing · kromquant
Params8.03B
Context16K
Smallest8.5 GB
GGUF
HA
Harbored
Harbored · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF
OR
Orotund
Orotund · kromquant
Params12B
Context128K
Smallest12.7 GB
GGUF

About kromquant on Hugging Face

kromquant has published 78 GGUF models that ggufmodels.com tracks, across families such as Testing, Siithamo and Spectre. The most downloaded are L3.1 Clouded Uchtave v0.1 8B GGUFs, L3.1 Aglow Vulca v0.1 8B GGUFs and Lacteous.

The quants kromquant publishes most often are Q8_0 (78), Q6_K (6), Q5_K_M (6) and Q4_K_M (6). Their Q4_K_M files range from 4.9 to 6.5 GB. Parameter counts run from 8.03B to 12B, and the longest trained context window is 4192K tokens.

Frequently asked questions

What GGUF models has kromquant published?

78 models are listed here, mainly from the Testing, Siithamo and Spectre families. The most downloaded is L3.1 Clouded Uchtave v0.1 8B GGUFs.

Which quants does kromquant publish?

The most common are Q8_0 (78 models), Q6_K (6 models), Q5_K_M (6 models) and Q4_K_M (6 models).

Keep browsing