Hermes GGUF models

149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
Hermes Instruct 7B 100K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes4 Philosopher Agent
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
HE
Hermes 4 70B Heretic
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
HE
Hermes Storm Climate Sauerkraut abliterated
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes-4-70B
Hermes · genevaquant
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
HE
Hermes4.3 Z
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
HE
conceptofmind_hermes-llongma-2-7b-8k
Hermes · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
Tool use
HE
Hermes 7B TR
Hermes · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes 4.3 36B ABLITERATED Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
Hermes Storm lorablated i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes Instruct 7B 217K
Hermes · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes Instruct 7B 217K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes Instruct 7B 100K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes 4.3 36B
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
HE
Models NousResearch Hermes 4.3 36B
Hermes · MaziyarPanahi
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
hermes stheno 8B v0.1 i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 2 Pro French i1
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
NousResearch.Hermes 4 70B
Hermes · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
HE
Hermes 4 14B
Hermes · genevaquant
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
Hermes 2 Pro 11B
Hermes · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
Tool use
HE
Hermes Euryale 70B i1
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
Hermes2Yi 34B 40k
Hermes · mradermacher
Params34.4B
Context40K
Q4_K_M20.7 GB
Tool use
HE
Hermes A1 20B
Hermes · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
HE
Hermes Storm Climate lorablated i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B OBLITERATED
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
hermes-Lexi-fun-stone-l3-8b
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
Hermes3.5 2B Hermes v2
Hermes · keithlol
Params1.94B
Context256K
Smallest2.1 GB
ReasoningTool useVision

Keep browsing