Holo GGUF models

89 GGUF models in the Holo family, quantized by 20 uploaders. Sizes run from 8M to 235B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HO
Holo2 8B
Holo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
HO
Holo1 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
HO
Holo1 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HO
Holo 3.1 0.8B
Holo · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool use
HO
Holo1.5 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
HO
Holo 3.1 4B Coder Abliterated Failspy
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
HO
Holo4 35B A3B
Holo · prithivMLmods
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool useVision
HO
Holo 3.1 4B Uncensored Heretic
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
HO
Holo3 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
HO
Holo 3.1 9B
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
HO
Holo 3.1 4B Coder
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
HO
Holo 3.1 35B A3B MTP
Holo · gbuzhf
Params447M
Context—
Smallest0.2 GB
GGUF
HO
Holo 3.1 9B Coder
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
HO
Holo 3.1 4B Coder Abliterated Failspy
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
HO
Holo 3.1 4B
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
HO
Holo1 3B
Holo · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
HO
Holo1.5 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HO
Holo 3.1 35B A3B
Holo · barozp
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
HO
Holo 3.1 4B Abliterated Rdo
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
HO
Holo 3.1 35B A3B Heretic
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
HO
Holo 3.1 9B Abliterated Rdo
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
HO
Holo4 27B
Holo · abenzerps
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
HO
Holo4 35B A3B
Holo · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
HO
Holo2 4B
Holo · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
HO
Holo 3.1 4B Abliterated Rdo
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
HO
Holo 3.1 9B Abliterated Rdo
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use

Keep browsing