Holo GGUF models
89 GGUF models in the Holo family, quantized by 20 uploaders. Sizes run from 8M to 235B parameters. The longest trained context is 256K tokens.
HO
Hcompany.Holo4 35B A3B
Holo · DevQuasar
Params34.7B
Context256K
Smallest12.9 GB
HO
Holo1 7B
Holo · ReallyFloppyPenguin
Params7.62B
Context125K
Smallest4.4 GB
HO
Holo4 35b A3B Heretic
Holo · jduraes
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo1.5 3B
Holo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
HO
Holo 3.1 4B Uncensored Heretic
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo1.5 3B
Holo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
HO
Hcompany.Holo1 7B
Holo · DevQuasar
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Hcompany.Holo4 27B
Holo · DevQuasar
Params26.9B
Context256K
Smallest10.7 GB
HO
Holo1 3B
Holo · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
HO
Holo 3.1 4B Coder
Holo · josephmayo
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Hcompany.Holo3 35B A3B
Holo · DevQuasar
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo 3.1 0.8B Abliterated Rdo
Holo · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
HO
Holo 3.1 0.8B Abliterated Rdo
Holo · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
HO
Holo 3.1 4B Coder
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Q4_K_M3.1 GB
HO
Holo4 35b A3B Heretic
Holo · jduraes
Params34.7B
Context256K
Smallest28.5 GB
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Q4_K_M0.7 GB
HO
mantis
Holo · cabal-ai
Params8M
Context—
Smallest0.0 GB
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest0.8 GB
HO
Holo1 3B
Holo · ReallyFloppyPenguin
Params3.09B
Context125K
Smallest1.8 GB
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest5.2 GB
HO
Holo1.5 3B
Holo · SakaiSec
Params3.4B
Context125K
Q4_K_M2.1 GB
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Smallest8.1 GB
HO
Holo 3 1 35B A3B
Holo · Riconec
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo1.5 7B
Holo · SakaiSec
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest1.1 GB
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest4.0 GB
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
quantized models
Holo · baxin
Params11.9B
Context256K
Q4_K_M0.7 GB