GGUF models by s3nh

182 GGUF models quantized by s3nh on Hugging Face. Sizes run from 160M to 46.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
JE
jeff31415 TinyLlama 1.1B 1.5T OpenOrca Alpha
Jeff · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LA
s3nh Law Noromaid 13b
Law · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
MA
MarkrAI MarK2 10.7B
Markrai · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SA
SanjiWatsuki Silicon Maid 7B
Sanjiwatsuki · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
s3nh Noromaid Panda 7B
Noromaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
likenneth honest llama2 chat 7B
Llama · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GU
Guilherme34 Samantha v2
Guilherme · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spanicin Fulcrum 7B slerp
Spanicin · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OE
OEvortex HelpingAI
Oevortex · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
DopeorNope Mark1 10.7B
Dopeornope · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
UN
Undi95 Unholy v2 13B
Undi · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
Henk717 spring dragon
Henk · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
UN
Unbabel TowerInstruct 7B v0.1
Unbabel · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
OProver 8B Base
Oprover · s3nh
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
FL
flux-7b-v0.2
Flux · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
akjindal53244 Arithmo Mistral 7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AZ
azale ai Starstreak 7b alpha
Azale · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Noromaid-Aeryth-7B
Noromaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
intfloat e5 mistral 7b instruct
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
sethuiyer SynthIQ 7b
Sethuiyer · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GI
gizmo ai Starling LM 7B alpha
Gizmo · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openerotica cockatrice 7b v0.2
Openerotica · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
YeungNLP firefly llama 13b
Llama · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MA
Masterjp123 NeuralMaid 7b
Masterjp · s3nh
Params7.02B
Context32K
Q4_K_M4.2 GB
GGUF
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Sydney_Pirate_Mistral_7b
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MathLLM MathCoder L 7B
Mathllm · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
FlagAlpha Llama2 Chinese 13b Chat
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JE
jeonsworld CarbonVillain 10.7B v1
Jeonsworld · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FU
functionary-small-v2.2
Functionary · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing