GGUF models by s3nh
182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.
EV
Evangelion-7B
Evangelion · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
neuronovo-7B-v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB