GGUF models by Guilherme34

89 GGUF models quantized by Guilherme34 on Hugging Face. Sizes run from 4M to 406B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sadtest
Sadtest · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
Tool use
FI
Firefly V2 Abliterated
Firefly · Guilherme34
Params3.61B
Context128K
Smallest3.8 GB
GGUF
MI
MiniAGI Selfimprove
Miniagi · Guilherme34
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CU
Curious Alpha Dontdownload
Curious · Guilherme34
Params4.33B
Context256K
Smallest4.6 GB
ReasoningTool useVision
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwen 3 4B Samantha 2.0 Stillintraining Step 1400
Qwen · Guilherme34
Params4.02B
Context256K
Smallest4.3 GB
ReasoningTool use
FI
Firefly V2
Firefly · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
GGUF
ME
MediumAGI
Mediumagi · Guilherme34
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
AR
ArliAI RPMax Formax v1 Q4 K M
Arliai · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
Samantha MoE Q4 K M
Samantha · Guilherme34
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Qwen Samantha 2.0
Qwen · Guilherme34
Params32.8B
Context40K
Smallest12.3 GB
ReasoningTool use
FI
Firefly V2.5
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
GGUF
MA
Maya Q3 K L
Maya · Guilherme34
Params3.3B
Context128K
Smallest1.9 GB
Tool use
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest1.9 GB
GGUF
PO
Poke Test Model Base
Poke · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
PS
Psychologist 3b Beta
Psychologist · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MI
MiniAGI Selfimprove
Miniagi · Guilherme34
Params7.62B
Context32K
Smallest6.3 GB
Tool use
01
01 v2 Q4 0
Guilherme34
Params8.03B
Context128K
Smallest4.7 GB
Tool use
YA
Yanfei v2 SamCool
Yanfei · Guilherme34
Params32.8B
Context40K
Smallest12.3 GB
ReasoningTool use
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
GGUF
FI
Firefly V2
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
GGUF
AR
ArliAI RPMax Formax v1 Q6 K
Arliai · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
GGUF
QW
Qwen 3 4B Samantha 2.0 Stillintraining Step 1400
Qwen · Guilherme34
Params4.02B
Context256K
Smallest2.4 GB
ReasoningTool use
PS
Psychologist 3b Beta
Psychologist · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SA
SamanthaCode v1
Samanthacode · Guilherme34
Params6.74B
Context16K
Smallest7.2 GB
GGUF
ME
MediumAGI V2
Mediumagi · Guilherme34
Params32.8B
Context32K
Smallest14.4 GB
CodingTool use
RE
Reasoning 2.6 fixed Q4 K M
Reasoning · Guilherme34
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
GGUF
SA
Samantha v7 4b Lesscensored
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
PH
Samantha phi3
Phi · Guilherme34
Params3.82B
Context128K
Smallest2.8 GB
GGUF

Keep browsing