Samantha GGUF models

89 GGUF models in the Samantha family, quantized by 15 uploaders. Sizes run from 1.1B to 120B parameters. The longest trained context is 10240K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SA
Samantha v6 i1
Samantha · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
samantha 1.1 westlake 7b
Samantha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Samantha 1.11 7b
Samantha · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Samantha 33b
Samantha · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SA
Samantha 1.11 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
Samantha roleplay ptbr v2
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
SA
Samantha Roleplay UWU 40B i1
Samantha · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
SA
Samantha v7 4b Lesscensored
Samantha · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Samantha 1.1 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
Samantha 1.1 Westlake 7b
Samantha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Samantha Roleplay UWU 40B
Samantha · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
SA
Dr_Samantha-7b
Samantha · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
Samantha 1.11 13b
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
Samantha hermes3 8b model fixed i1
Samantha · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha 7b
Samantha · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
Samantha roleplay ptbr v2 i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
SA
Samantha 13b
Samantha · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
SA
Samantha v6
Samantha · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha v7 4b
Samantha · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SA
Samantha V2.0
Samantha · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
SA
Samantha 1.11 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
Dr Samantha 7b
Samantha · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
SA
Samantha vision v2
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
SA
samantha-1.1-westlake-7b
Samantha · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Samantha tinyllama 1.1b v2 modelnotloranotquantized
Samantha · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SA
Samantha Big MoE
Samantha · mradermacher
Params108B
Context10240K
Smallest39.6 GB
Tool use
SA
samantha 1.1 westlake 7b
Samantha · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Samantha hermes3 8b model fixed
Samantha · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha v6
Samantha · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Weyaxi/Samantha-Nebula-7B
Samantha · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing