GGUF models by s3nh

182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
EV
Evangelion-7B
Evangelion · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
neuronovo-7B-v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF

Keep browsing