GGUF models by s3nh
182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.
OB
Obrolin Kesehatan 7B
Obrolin · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Faraday-7B
Faraday · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
Tensoic TinyLlama 1.1B 3T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
EL
elonmollusk neuralogix neural chat v1
Elonmollusk · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sao10K Sensualize Solar 10.7B
Sao · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
SN
SnowLotus v2 10.7B
Snowlotus · s3nh
Params7.82B
Context4K
Q4_K_M4.7 GB
KE
Ketak ZoomRx Drug Ollama v3 2
Ketak · s3nh
Params160M
Context—
Smallest0.1 GB
SO
s3nh Sonya Panda 7B slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
mistral-7b-lamia-v0.1b
Mistral · s3nh
Params7.24B
Context128K
Q4_K_M4.4 GB
DO
DopeorNope SOLARC M 10.7B
Dopeornope · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 2 13b chat dutch
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
YA
Yash21 SuperChat 7B
Yash · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AZ
Azazelle Yuna 7b Merge
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
cockatrice-7b-v0.3
Cockatrice · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TIGER Lab TIGERScore 7B V1.0
Tiger · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
JA
jan hq supermario v2
Jan · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kunocchini-7b-128k-test
Kunocchini · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sethuiyer Dr Samantha 7b mistral
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Delcos Velara 11B V2
Delcos · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
ML
mlabonne Marcoro14 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
EL
elonmollusk neuralogix openhermes v2
Elonmollusk · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DO
Doctor Shotgun TinyLlama 1.1B 32k Instruct
Doctor · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
AR
arkanbima Aethizin 10.7B
Arkanbima · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
WE
Wernicke-7B-dpo
Wernicke · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kunoichi-DPO-v2-7B
Kunoichi · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
CY
Cybertron-UNA-11b-v2
Cybertron · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
TO
ToolBench ToolLLaMA 2 7b v1
Toolbench · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
PI
PistachioAlt Noromaid Bagel 7B Slerp
Pistachioalt · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
HI
HiTZ GoLLIE 13B
Hitz · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
TI
TinyGauss-1.1B
Tinygauss · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB