Samantha GGUF models

89 GGUF models in the Samantha family, quantized by 15 uploaders. Sizes run from 1.1B to 120B parameters. The longest trained context is 10240K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
safespace 7b
Samantha · danlou
Params6.74B
Context4K
Smallest3.8 GB
GGUF
SA
Samantha v7 4b
Samantha · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Samantha 120b
Samantha · mradermacher
Params120B
Context4K
Smallest44.5 GB
GGUF
SA
Samantha v7 4b Lesscensored
Samantha · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SA
Samantha Mythomax l2 13b merge fixed Q3 K S
Samantha · Guilherme34
Params13B
Context4K
Smallest5.7 GB
GGUF
SA
Samantha OSONE 7b
Samantha · Guilherme34
Params6.74B
Context4K
Smallest7.2 GB
GGUF
SA
Samantha 3b Beta0.1 Model
Samantha · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SA
Samantha Mythomax l2 13b merge fixed Q3 K L
Samantha · Guilherme34
Params13B
Context4K
Smallest6.9 GB
GGUF
SA
Samantha vision
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
Vision
SA
Samantha test Q4 K M
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
SA
Samantha Mythomax l2 13b merge fixed Q2 K
Samantha · Guilherme34
Params13B
Context4K
Smallest4.9 GB
GGUF
SA
Samantha Mythomax l2 13b merge fixed Q4 K M
Samantha · Guilherme34
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
samantha 1.1 MBX 7B
Samantha · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Dr_Samantha-7b
Samantha · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
Samantha MoE Q4 K M
Samantha · Guilherme34
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
SA
Samantha v7 4b Lesscensored
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SA
Samantha v2.5
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha hermes3 8b model fixed Q8 0
Samantha · Guilherme34
Params8.03B
Context128K
Smallest8.5 GB
Tool use
SA
Samantha hermes3 8b model fixed Q6 K
Samantha · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
Tool use
SA
Samantha v7 4b
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SA
Samantha v6 Q4 K M
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha tiny
Samantha · Guilherme34
Params1.1B
Context2K
Smallest1.2 GB
GGUF
SA
Samantha v2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha 120b
Samantha · LoneStriker
Params120B
Context4K
Smallest44.2 GB
GGUF
SA
Samantha wizardlm2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha MoE Q2 K
Samantha · Guilherme34
Params12.9B
Context32K
Smallest4.8 GB
GGUF
SA
Samantha v6
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha-Nebula-7B
Samantha · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SamanTha Solar v4
Samantha · sost0409
Params10.7B
Context4K
Smallest7.6 GB
GGUF

Keep browsing