GGUF models by s3nh
182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.
TO
totally not an llm AlpacaCielo2 7b 8k
Totally · s3nh
Params6.74B
Context8K
Q4_K_M4.1 GB
SA
SanjiWatsuki Sonya 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
FN
fnlp moss base 7b
Fnlp · s3nh
Params7.23B
Context2K
Q4_K_M4.4 GB
TI
TinyDolphin 2.8 1.1b
Tinydolphin · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
GE
GeneZC MiniChat 2 3B
Genezc · s3nh
Params3.02B
Context4K
Q4_K_M1.8 GB
MI
Thespis-Mistral-7b-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DaringLotus v2 10.7b
Daringlotus · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
UT
UTENA-7B-V3
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open Orca OpenOrca Preview1 13B
Open · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
NE
NeverSleepHistorical Noromaid 7B 0.4
Neversleephistorical · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
diffnamehard Psyfighter2 Noromaid ties 13B
Diffnamehard · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GA
garage bAInd Stable Platypus2 13B
Garage · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
HI
HiTZ GoLLIE 7B
Hitz · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
NA
NarutoDolphin-10B
Narutodolphin · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
TI
TinyLlama-1.1B-32k
Tinyllama · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
MI
Mistral-7B-Evol-Instruct-Chinese
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GEITje-7B-ultra
Geitje · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MaziyarPanahi Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Novocode7b-v3
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
WestLake-7B-v2
Westlake · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
phanerozoic Mistral Pirate 7b v0.3
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
TencentARC LLaMA Pro 8B Instruct
Llama · s3nh
Params8.36B
Context4K
Q4_K_M5.1 GB
WH
whiterabbitneo WhiteRabbitNeo 13B
Whiterabbitneo · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
ME
s3nh Medicine Noromaid 13b
Medicine · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
NE
NexoNimbus-7B
Nexonimbus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
Patronum-7B
Patronum · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
hunkim NousResearch Llama 2 7b hf ko 7 koalpaca v1.1a kopen platypus
Llama · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
ML
mlabonne NeuralPipe 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
beberik Lonepino 11B
Beberik · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
migtissera Synthia 7B v1.2
Migtissera · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB