Heretic GGUF models

136 GGUF models in the Heretic family, quantized by 10 uploaders. Sizes run from 268M to 299B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
Heretic 5Q3 Nexus Coder MAX
Heretic · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
HE
Heretic.Anomaly 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic Mimma 3 1b
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic1.5b
Heretic · mradermacher
Params1.73B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
HE
Heretic 3b
Heretic · mradermacher
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
HE
Hy3 Heretic
Heretic · prometheusAIR
Params299B
Context256K
Smallest81.4 GB
ReasoningTool use
HE
Heretic SLM Uncensored
Heretic · OpenIntelligenceNet
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
HE
Heretic VexGPT
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
heretic baron v2 shortcircuit q8
Heretic · techninja2390
Params14.8B
Context40K
Smallest15.7 GB
GGUF
HE
Heretic SLM Uncensored Imatrix
Heretic · OpenIntelligenceNet
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
HE
Hy3 Heretic
Heretic · audreyt
Params295B
Context—
Smallest96.5 GB
GGUF
HE
Gm4 31B HERETIC Thinking it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool use
HE
Heretic 3b
Heretic · dwnmf
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
HE
Gm4 26B A4B heretic i1
Heretic · ineosnexus
Params25.2B
Context256K
Smallest22.6 GB
ReasoningTool use
HE
Gm4 31B heretic it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool use
HE
Gm4 31B heretic ara it i1
Heretic · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool use

Keep browsing