GGUF models by s3nh

182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Tensoic TinyLlama 1.1B 2.5T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
DU
DuckDB-NSQL-7B-v0.1
Duckdb · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
OC
occultml Helios 10.7B v2
Occultml · s3nh
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LO
Loquace-tiny-1.1B
Loquace · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ED
Edentns DataVortexM 7B Instruct v0.1
Edentns · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
HamSter-0.2
Hamster · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Blurred-Beagle-7b-slerp
Blurred · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
TachyHealth Thealth SLERP
Tachyhealth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CR
CrystalMistral_7b_v.01
Crystalmistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Neuronovo neuronovo 7B v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
AE
Aeryth-7B-v0.1
Aeryth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MU
multimaster-7b
Multimaster · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SA
Sao10K Winterreise m7
Sao · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
ALMA 7B
Alma · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
ToolBench ToolLLaMA 2 7b v2
Toolbench · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Novocode7b
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SanjiWatsuki Lelantos 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DI
DistilabelBeagle14-7B
Distilabelbeagle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.2-Neural-Story
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LM
lmsys longchat 7b v1.5 32k
Lmsys · s3nh
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
CH
Chikuma_10.7B
Chikuma · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LA
latxa 7b v1
Latxa · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
MedChat3.5
Medchat · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
NeuralBeagle-11B
Neuralbeagle · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
FR
Fredithefish CanarY
Fredithefish · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AT
AthenaImaniMaven
Athenaimanimaven · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-lamia-v0.1
Mistral · s3nh
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
WE
WestSeverus-7B-DPO
Westseverus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Metabird-7B
Metabird · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing