Heretic GGUF models
136 GGUF models in the Heretic family, quantized by 10 uploaders. Sizes run from 268M to 299B parameters. The longest trained context is 1024K tokens.
HE
Heretic 5Q3 Nexus Coder MAX
Heretic · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HE
Heretic.Anomaly 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
HE
Heretic Mimma 3 1b
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
HE
Heretic1.5b
Heretic · mradermacher
Params1.73B
Context128K
Q4_K_M1.1 GB
HE
Heretic 3b
Heretic · mradermacher
Params3.93B
Context256K
Q4_K_M2.4 GB
HE
Hy3 Heretic
Heretic · prometheusAIR
Params299B
Context256K
Smallest81.4 GB
HE
Heretic SLM Uncensored
Heretic · OpenIntelligenceNet
Params2.57B
Context125K
Q4_K_M1.6 GB
HE
Heretic VexGPT
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
HE
heretic baron v2 shortcircuit q8
Heretic · techninja2390
Params14.8B
Context40K
Smallest15.7 GB
HE
Heretic SLM Uncensored Imatrix
Heretic · OpenIntelligenceNet
Params2.57B
Context125K
Q4_K_M1.6 GB
HE
Hy3 Heretic
Heretic · audreyt
Params295B
Context—
Smallest96.5 GB
HE
Gm4 31B HERETIC Thinking it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
HE
Heretic 3b
Heretic · dwnmf
Params3.93B
Context256K
Q4_K_M2.4 GB
HE
Gm4 26B A4B heretic i1
Heretic · ineosnexus
Params25.2B
Context256K
Smallest22.6 GB
HE
Gm4 31B heretic it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
HE
Gm4 31B heretic ara it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB