GGUF models by s3nh

182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralDaredevil-7B
Neuraldaredevil · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
koala-7B-slerp
Koala · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
ML
mlabonne Marcoro14 7B ties
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
golaxy gogpt2 7b
Golaxy · s3nh
Params7.04B
Context2K
Q4_K_M4.3 GB
GGUF
AZ
Azazelle Tippy Toppy 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VO
Voldemort-10B-DPO
Voldemort · s3nh
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
AZ
Azazelle Maylin 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
Tiger-7b-v0.1
Tiger · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AB
abacusai Giraffe 13b 32k v3
Abacusai · s3nh
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
MH
mhm-7b-v1.3-DPO-1
Mhm · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
GOAT-Finance-7B
Goat · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AL
ALMA 13B
Alma · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral_Sonyichi-7B-slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Rhino-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Hermaid-7B
Hermaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LA
latxa 13b v1
Latxa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
Lelantos-Maid-DPO-7B
Lelantos · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Newton-7B
Newton · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DA
DaringLotus
Daringlotus · s3nh
Params7.88B
Context4K
Q4_K_M4.7 GB
GGUF
MI
Thespis-Mistral-7b-Alpha-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Dr_Samantha-7b
Samantha · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CR
Crunchy-onion
Crunchy · s3nh
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TI
TinyLlama-de-stage2-v0.7
Tinyllama · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SY
Synatra-7B-v0.3-dpo
Synatra · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UT
UTENA-7B-UNA-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
Gorgon-7b-v0.1
Gorgon · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Velara-11B-V2
Velara · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
DA
Daisuke
Daisuke · s3nh
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SO
Sonya-Panda-7B-slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AT
AtAndDev ShortKing 3b v0.2
Atanddev · s3nh
Params160M
Context—
Smallest0.1 GB
GGUF

Keep browsing