Holo GGUF models

89 GGUF models in the Holo family, quantized by 20 uploaders. Sizes run from 8M to 235B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HO
Hcompany.Holo4 35B A3B
Holo · DevQuasar
Params34.7B
Context256K
Smallest12.9 GB
ReasoningTool useVision
HO
Holo1 7B
Holo · ReallyFloppyPenguin
Params7.62B
Context125K
Smallest4.4 GB
GGUF
HO
Holo4 35b A3B Heretic
Holo · jduraes
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
HO
Holo1.5 3B
Holo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Vision
HO
Holo 3.1 4B Uncensored Heretic
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
HO
Holo1.5 3B
Holo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
GGUF
HO
Hcompany.Holo1 7B
Holo · DevQuasar
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HO
Hcompany.Holo4 27B
Holo · DevQuasar
Params26.9B
Context256K
Smallest10.7 GB
ReasoningTool useVision
HO
Holo1 3B
Holo · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
GGUF
HO
Holo 3.1 4B Coder
Holo · josephmayo
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
HO
Hcompany.Holo3 35B A3B
Holo · DevQuasar
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
HO
Holo 3.1 0.8B Abliterated Rdo
Holo · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
HO
Holo 3.1 0.8B Abliterated Rdo
Holo · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
HO
Holo 3.1 4B Coder
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
HO
Holo4 35b A3B Heretic
Holo · jduraes
Params34.7B
Context256K
Smallest28.5 GB
ReasoningTool useVision
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
HO
mantis
Holo · cabal-ai
Params8M
Context—
Smallest0.0 GB
GGUF
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest0.8 GB
ReasoningTool useVision
HO
Holo1 3B
Holo · ReallyFloppyPenguin
Params3.09B
Context125K
Smallest1.8 GB
GGUF
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest5.2 GB
ReasoningTool useVision
HO
Holo1.5 3B
Holo · SakaiSec
Params3.4B
Context125K
Q4_K_M2.1 GB
Vision
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Smallest8.1 GB
Vision
HO
Holo 3 1 35B A3B
Holo · Riconec
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
HO
Holo1.5 7B
Holo · SakaiSec
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest1.1 GB
ReasoningTool useVision
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest4.0 GB
ReasoningTool useVision
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HO
quantized models
Holo · baxin
Params11.9B
Context256K
Q4_K_M0.7 GB
ReasoningTool use

Keep browsing