GGUF models by s3nh
182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.
TE
Tensoic TinyLlama 1.1B 2.5T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
DU
DuckDB-NSQL-7B-v0.1
Duckdb · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
OC
occultml Helios 10.7B v2
Occultml · s3nh
Params7.24B
Context4K
Q4_K_M4.4 GB
LO
Loquace-tiny-1.1B
Loquace · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
ED
Edentns DataVortexM 7B Instruct v0.1
Edentns · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
HamSter-0.2
Hamster · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
Blurred-Beagle-7b-slerp
Blurred · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
TachyHealth Thealth SLERP
Tachyhealth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
CR
CrystalMistral_7b_v.01
Crystalmistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Neuronovo neuronovo 7B v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
AE
Aeryth-7B-v0.1
Aeryth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MU
multimaster-7b
Multimaster · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
SA
Sao10K Winterreise m7
Sao · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
ALMA 7B
Alma · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
TO
ToolBench ToolLLaMA 2 7b v2
Toolbench · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
NO
Novocode7b
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SanjiWatsuki Lelantos 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
DI
DistilabelBeagle14-7B
Distilabelbeagle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.2-Neural-Story
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LM
lmsys longchat 7b v1.5 32k
Lmsys · s3nh
Params6.74B
Context32K
Q4_K_M4.1 GB
CH
Chikuma_10.7B
Chikuma · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
LA
latxa 7b v1
Latxa · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
MedChat3.5
Medchat · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
NE
NeuralBeagle-11B
Neuralbeagle · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
FR
Fredithefish CanarY
Fredithefish · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
AT
AthenaImaniMaven
Athenaimanimaven · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-7b-lamia-v0.1
Mistral · s3nh
Params7.24B
Context128K
Q4_K_M4.4 GB
WE
WestSeverus-7B-DPO
Westseverus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Metabird-7B
Metabird · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
ES
EstopianMaid 13B
Estopianmaid · s3nh
Params13B
Context4K
Q4_K_M7.9 GB