GGUF models by IsValorum
61 GGUF models quantized by IsValorum on Hugging Face. Sizes run from 96M to 42.6B parameters. The longest trained context is 256K tokens.
CL
Clover 35B A3B Preview VAL 1.25M I Matrix
Clover · IsValorum
Params96M
Context—
Smallest0.4 GB
TH
Thomson 1.0 Small
Thomson · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
AX
Axion 1.0 35B
Axion · IsValorum
Params34.7B
Context256K
Smallest36.9 GB
QW
Qwen3.8 27B TTURBO 709 Uncen BF16
Qwen · IsValorum
Params27.3B
Context256K
Smallest54.7 GB
SA
Sage A1.5 VAL 1M I Matrix
Sage · IsValorum
Params96M
Context—
Smallest0.4 GB
GR
Groot 65B A6B 261023 VAL 1.25M I Matrix
Groot · IsValorum
Params148M
Context—
Smallest0.6 GB