Holo GGUF models
89 GGUF models in the Holo family, quantized by 20 uploaders. Sizes run from 8M to 235B parameters. The longest trained context is 256K tokens.
HO
Holo2 8B
Holo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
HO
Holo1 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Holo1 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Holo 3.1 0.8B
Holo · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
HO
Holo1.5 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Holo 3.1 4B Coder Abliterated Failspy
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo4 35B A3B
Holo · prithivMLmods
Params34.7B
Context256K
Smallest19.8 GB
HO
Holo 3.1 4B Uncensored Heretic
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HO
Holo3 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo 3.1 9B
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HO
Holo 3.1 4B Coder
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo 3.1 35B A3B MTP
Holo · gbuzhf
Params447M
Context—
Smallest0.2 GB
HO
Holo 3.1 9B Coder
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HO
Holo 3.1 4B Coder Abliterated Failspy
Holo · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HO
Holo 3.1 4B
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
HO
Holo1 3B
Holo · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
HO
Holo1.5 7B
Holo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
Holo 3.1 35B A3B
Holo · barozp
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo 3.1 4B Abliterated Rdo
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
HO
Holo 3.1 35B A3B Heretic
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo 3.1 9B Abliterated Rdo
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HO
Holo4 27B
Holo · abenzerps
Params26.9B
Context256K
Q4_K_M16.5 GB
HO
Holo4 35B A3B
Holo · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
HO
Holo2 4B
Holo · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
HO
Holo 3.1 4B Abliterated Rdo
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
HO
Holo 3.1 9B Abliterated Rdo
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB