GGUF models by s3nh
182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.
NE
NeuralDaredevil-7B
Neuraldaredevil · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
koala-7B-slerp
Koala · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
ML
mlabonne Marcoro14 7B ties
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GO
golaxy gogpt2 7b
Golaxy · s3nh
Params7.04B
Context2K
Q4_K_M4.3 GB
AZ
Azazelle Tippy Toppy 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
VO
Voldemort-10B-DPO
Voldemort · s3nh
Params10.7B
Context8K
Q4_K_M6.5 GB
AZ
Azazelle Maylin 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Tiger-7b-v0.1
Tiger · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AB
abacusai Giraffe 13b 32k v3
Abacusai · s3nh
Params13B
Context32K
Q4_K_M7.9 GB
MH
mhm-7b-v1.3-DPO-1
Mhm · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GO
GOAT-Finance-7B
Goat · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
AL
ALMA 13B
Alma · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral_Sonyichi-7B-slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Rhino-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermaid-7B
Hermaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LA
latxa 13b v1
Latxa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
LE
Lelantos-Maid-DPO-7B
Lelantos · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Newton-7B
Newton · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
DA
DaringLotus
Daringlotus · s3nh
Params7.88B
Context4K
Q4_K_M4.7 GB
MI
Thespis-Mistral-7b-Alpha-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Dr_Samantha-7b
Samantha · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
CR
Crunchy-onion
Crunchy · s3nh
Params46.7B
Context32K
Q4_K_M28.4 GB
TI
TinyLlama-de-stage2-v0.7
Tinyllama · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
SY
Synatra-7B-v0.3-dpo
Synatra · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
UT
UTENA-7B-UNA-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GO
Gorgon-7b-v0.1
Gorgon · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Velara-11B-V2
Velara · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
DA
Daisuke
Daisuke · s3nh
Params20B
Context4K
Q4_K_M12.0 GB
SO
Sonya-Panda-7B-slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
AT
AtAndDev ShortKing 3b v0.2
Atanddev · s3nh
Params160M
Context—
Smallest0.1 GB