GGUF models by s3nh

182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
totally not an llm AlpacaCielo2 7b 8k
Totally · s3nh
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
SA
SanjiWatsuki Sonya 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
FN
fnlp moss base 7b
Fnlp · s3nh
Params7.23B
Context2K
Q4_K_M4.4 GB
GGUF
TI
TinyDolphin 2.8 1.1b
Tinydolphin · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
GE
GeneZC MiniChat 2 3B
Genezc · s3nh
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
MI
Thespis-Mistral-7b-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DaringLotus v2 10.7b
Daringlotus · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UT
UTENA-7B-V3
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Open Orca OpenOrca Preview1 13B
Open · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
NeverSleepHistorical Noromaid 7B 0.4
Neversleephistorical · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
diffnamehard Psyfighter2 Noromaid ties 13B
Diffnamehard · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GA
garage bAInd Stable Platypus2 13B
Garage · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HI
HiTZ GoLLIE 7B
Hitz · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
NA
NarutoDolphin-10B
Narutodolphin · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TI
TinyLlama-1.1B-32k
Tinyllama · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
MI
Mistral-7B-Evol-Instruct-Chinese
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GEITje-7B-ultra
Geitje · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MaziyarPanahi Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Novocode7b-v3
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestLake-7B-v2
Westlake · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
phanerozoic Mistral Pirate 7b v0.3
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
TencentARC LLaMA Pro 8B Instruct
Llama · s3nh
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
WH
whiterabbitneo WhiteRabbitNeo 13B
Whiterabbitneo · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
ME
s3nh Medicine Noromaid 13b
Medicine · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
NE
NexoNimbus-7B
Nexonimbus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Patronum-7B
Patronum · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hunkim NousResearch Llama 2 7b hf ko 7 koalpaca v1.1a kopen platypus
Llama · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ML
mlabonne NeuralPipe 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
beberik Lonepino 11B
Beberik · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
migtissera Synthia 7B v1.2
Migtissera · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing