GGUF models by Guilherme34

89 GGUF models quantized by Guilherme34 on Hugging Face. Sizes run from 4M to 406B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Samful
Samful · Guilherme34
Params4.02B
Context256K
Smallest4.3 GB
ReasoningTool use
SA
Samful
Samful · Guilherme34
Params4.02B
Context256K
Smallest3.3 GB
ReasoningTool use
01
01 v2 Q4 K M
Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Samantha v2.5
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha hermes3 8b model fixed Q8 0
Samantha · Guilherme34
Params8.03B
Context128K
Smallest8.5 GB
Tool use
SA
Samantha hermes3 8b model fixed Q6 K
Samantha · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
Tool use
RE
Reasoning test merged Q6 K
Reasoning · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
Reasoning
ME
MediumAGI
Mediumagi · Guilherme34
Params32.8B
Context32K
Smallest26.9 GB
CodingTool use
PS
Psychologist GGUF 3b Q8 0
Psychologist · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
Tool use
GE
gemma 3 sentient
Gemma · Guilherme34
Params27B
Context128K
Smallest28.7 GB
GGUF
SA
Samantha v7 4b
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SA
Samantha v6 Q4 K M
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
JE
Jenniferv4
Jenniferv · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha tiny
Samantha · Guilherme34
Params1.1B
Context2K
Smallest1.2 GB
GGUF
LU
Lumina Q4 K M
Lumina · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
01
01 v2 Q6 K
Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
Tool use
QW
Qwen3 Conscious Fullmodel
Qwen · Guilherme34
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
SA
Samantha v2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
JE
Jennifer uwu version
Jennifer · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha wizardlm2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
Samantha MoE Q2 K
Samantha · Guilherme34
Params12.9B
Context32K
Smallest4.8 GB
GGUF
RE
Reasoning test merged Q4 K S
Reasoning · Guilherme34
Params8.03B
Context128K
Smallest4.7 GB
Reasoning
QW
Qwen Samantha 2.0
Qwen · Guilherme34
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
SA
Samantha v6
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Samantha mixtraldolphin GGUF q2
Mistral · Guilherme34
Params46.7B
Context32K
Smallest17.3 GB
GGUF
RE
Reasoning 2.6 fixed Q8 0
Reasoning · Guilherme34
Params1.24B
Context128K
Smallest1.3 GB
Reasoning
RE
Reasoning 2.6 fixed Q6 K
Reasoning · Guilherme34
Params1.24B
Context128K
Smallest1.0 GB
Reasoning
MA
Maya Q2 K
Maya · Guilherme34
Params3.3B
Context128K
Smallest1.4 GB
Tool use
MI
Samantha mixtraldolphin
Mistral · Guilherme34
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen3 Conscious Fullmodel v2
Qwen · Guilherme34
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use

Keep browsing