Hermes GGUF models

149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
Hermes3 Lumimaid uncensored i1
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes Instruct 7B v0.2
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes2Yi 34B 40k
Hermes · mradermacher
Params34.4B
Context40K
Q4_K_M20.7 GB
Tool use
HE
NousResearch.Hermes 4 14B
Hermes · DevQuasar
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
Hermes 4 14b Chat Template Retrain
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
hermes-lewdPlay-stone-l3-8b
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
raicrits Hermes7b ITA
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Tool use
HE
Hermes 4 70B
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
HE
Hermes 2 Pro French
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes3 Lumimaid uncensored
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes 4 405B i1
Hermes · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
HE
Hermes-Sthero-v1
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
hermes stheno 8B v0.1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes Instruct 7B 217K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes3 BlackSheep 3B i1
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
HE
Hermes4 Philosopher Agent
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
hermes
Hermes · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
Tool use
HE
L2 7b Hermes dolphin
Hermes · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
HE
Hermes Euryale 70B
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes3 L3.1 BigTalker 8B i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 3 iSMART
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B OBLITERATED V2
Hermes · RavichandranJ
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
HE
hermes-SOVL-stone-l3-8b
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B BF16 Abliterated
Hermes · n0kovo
Params14.8B
Context40K
Smallest12.1 GB
Tool use
HE
Hermes3 L3.1 DirtyHarry 8B
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B OBLITERATED
Hermes · RavichandranJ
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
HE
hermes 3 agent
Hermes · bethelclinton98
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.5 GB
ReasoningRoleplayTool use
HE
hermes-Poppy-stone-l3-8b
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
Hermes3 BlackSheep 3B
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing