Heretic GGUF models

136 GGUF models in the Heretic family, quantized by 10 uploaders. Sizes run from 268M to 299B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
Heretic Cotype Nano
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HE
Heretic Reasoning 0.5b
Heretic · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
HE
heretic_Minerva 1.5b_V0.2
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HE
Heretic Openhands Lm 1.5b v0.1
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HE
heretic_Qwill 0.6B IT FULL
Heretic · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
HE
A0l 12B Heretic
Heretic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic
Heretic · ponytang3
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
HE
heretic_DevilsAdvocate 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic_Oxy 1 Micro
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Roleplay
HE
Heretic Fox 1 1.6B Instruct v0.1
Heretic · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
HE
heretic_RimDialogue 3B v1
Heretic · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
HE
Heretic HY MT1.5 1.8B
Heretic · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
HE
heretic_Apollo 1 2B
Heretic · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
HE
Heretic Bellatrix Tiny 1B
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
Heretic_Aquif 3.6 1B
Heretic · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
Tool use
HE
Heretic Quyen v0.1
Heretic · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
HE
heretic nvidia Q8 0
Heretic · charlinoss
Params32.9B
Context1024K
Smallest35.0 GB
ReasoningTool use
HE
Heretic
Heretic · ponytang3
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
HE
heretic_AwA 1.5B
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HE
heretic_BlackSheep 1B
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
heretic_Genuine 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic SLM Uncensored VL
Heretic · OpenIntelligenceNet
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool useVision
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Heretic Arcee Lite
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
HE
Heretic Goppa LogiLlama
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
Heretic Qp 1B
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
HE
Heretic VexGPT
Heretic · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
Heretic.Erudite_v2 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
heretic_DevilsAdvocate 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF

Keep browsing