GGUF models by Guilherme34
89 GGUF models quantized by Guilherme34 on Hugging Face. Sizes run from 4M to 406B parameters. The longest trained context is 256K tokens.
SA
Sadtest
Sadtest · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
FI
Firefly V2 Abliterated
Firefly · Guilherme34
Params3.61B
Context128K
Smallest3.8 GB
MI
MiniAGI Selfimprove
Miniagi · Guilherme34
Params7.62B
Context32K
Q4_K_M4.7 GB
CU
Curious Alpha Dontdownload
Curious · Guilherme34
Params4.33B
Context256K
Smallest4.6 GB
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen 3 4B Samantha 2.0 Stillintraining Step 1400
Qwen · Guilherme34
Params4.02B
Context256K
Smallest4.3 GB
FI
Firefly V2
Firefly · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
ME
MediumAGI
Mediumagi · Guilherme34
Params32.8B
Context32K
Q4_K_M19.9 GB
AR
ArliAI RPMax Formax v1 Q4 K M
Arliai · Guilherme34
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Samantha MoE Q4 K M
Samantha · Guilherme34
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen Samantha 2.0
Qwen · Guilherme34
Params32.8B
Context40K
Smallest12.3 GB
FI
Firefly V2.5
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
MA
Maya Q3 K L
Maya · Guilherme34
Params3.3B
Context128K
Smallest1.9 GB
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest1.9 GB
PO
Poke Test Model Base
Poke · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
PS
Psychologist 3b Beta
Psychologist · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
MI
MiniAGI Selfimprove
Miniagi · Guilherme34
Params7.62B
Context32K
Smallest6.3 GB
01
01 v2 Q4 0
Guilherme34
Params8.03B
Context128K
Smallest4.7 GB
YA
Yanfei v2 SamCool
Yanfei · Guilherme34
Params32.8B
Context40K
Smallest12.3 GB
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest3.4 GB
FI
Firefly V2
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
AR
ArliAI RPMax Formax v1 Q6 K
Arliai · Guilherme34
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen 3 4B Samantha 2.0 Stillintraining Step 1400
Qwen · Guilherme34
Params4.02B
Context256K
Smallest2.4 GB
PS
Psychologist 3b Beta
Psychologist · Guilherme34
Params3.21B
Context128K
Q4_K_M2.0 GB
SA
SamanthaCode v1
Samanthacode · Guilherme34
Params6.74B
Context16K
Smallest7.2 GB
ME
MediumAGI V2
Mediumagi · Guilherme34
Params32.8B
Context32K
Smallest14.4 GB
RE
Reasoning 2.6 fixed Q4 K M
Reasoning · Guilherme34
Params1.24B
Context128K
Q4_K_M0.8 GB
FI
Firefly
Firefly · Guilherme34
Params3.21B
Context128K
Smallest2.6 GB
SA
Samantha v7 4b Lesscensored
Samantha · Guilherme34
Params3.88B
Context128K
Q4_K_M2.5 GB
PH
Samantha phi3
Phi · Guilherme34
Params3.82B
Context128K
Smallest2.8 GB