GGUF models by Guilherme34
89 GGUF models quantized by Guilherme34 on Hugging Face. Sizes run from 4M to 406B parameters. The longest trained context is 256K tokens.
SA
Samful
Samful · Guilherme34
Params4.02B
Context256K
Smallest4.3 GB
SA
Samful
Samful · Guilherme34
Params4.02B
Context256K
Smallest3.3 GB
01
01 v2 Q4 K M
Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Samantha v2.5
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
SA
Samantha hermes3 8b model fixed Q8 0
Samantha · Guilherme34
Params8.03B
Context128K
Smallest8.5 GB
SA
Samantha hermes3 8b model fixed Q6 K
Samantha · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
RE
Reasoning test merged Q6 K
Reasoning · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
ME
MediumAGI
Mediumagi · Guilherme34
Params32.8B
Context32K
Smallest26.9 GB
PS
Psychologist GGUF 3b Q8 0
Psychologist · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
GE
gemma 3 sentient
Gemma · Guilherme34
Params27B
Context128K
Smallest28.7 GB
SA
Samantha v7 4b
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
SA
Samantha v6 Q4 K M
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
JE
Jenniferv4
Jenniferv · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
SA
Samantha tiny
Samantha · Guilherme34
Params1.1B
Context2K
Smallest1.2 GB
LU
Lumina Q4 K M
Lumina · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
01
01 v2 Q6 K
Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen3 Conscious Fullmodel
Qwen · Guilherme34
Params596M
Context40K
Smallest0.6 GB
SA
Samantha v2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
JE
Jennifer uwu version
Jennifer · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
SA
Samantha wizardlm2
Samantha · Guilherme34
Params7.24B
Context32K
Smallest7.7 GB
SA
Samantha MoE Q2 K
Samantha · Guilherme34
Params12.9B
Context32K
Smallest4.8 GB
RE
Reasoning test merged Q4 K S
Reasoning · Guilherme34
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen Samantha 2.0
Qwen · Guilherme34
Params32.8B
Context40K
Q4_K_M19.8 GB
SA
Samantha v6
Samantha · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Samantha mixtraldolphin GGUF q2
Mistral · Guilherme34
Params46.7B
Context32K
Smallest17.3 GB
RE
Reasoning 2.6 fixed Q8 0
Reasoning · Guilherme34
Params1.24B
Context128K
Smallest1.3 GB
RE
Reasoning 2.6 fixed Q6 K
Reasoning · Guilherme34
Params1.24B
Context128K
Smallest1.0 GB
MA
Maya Q2 K
Maya · Guilherme34
Params3.3B
Context128K
Smallest1.4 GB
MI
Samantha mixtraldolphin
Mistral · Guilherme34
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3 Conscious Fullmodel v2
Qwen · Guilherme34
Params596M
Context40K
Smallest0.6 GB