Hermes GGUF models

149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
Hermes 4 14B BF16 Abliterated
Hermes · n0kovo
Params14.8B
Context40K
Smallest15.7 GB
Tool use
HE
Hermes 4 14B
Hermes · ignyse
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
HE
Hermes Synthia 7B
Hermes · Lazycuber
Params6.74B
Context4K
Smallest7.2 GB
Tool use
HE
UL3.3 Hermes X80 BASE 70B
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes 2 Pro Ninja V3
Hermes · NON906
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
hermes gguf vault
Hermes · Allell85
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
Hermes-4-70B
Hermes · Bluerosesbutterfly
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
HE
Hermes 2 Pro French
Hermes · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
Tool use
HE
Hermes 3 Remix L3.2 3b
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
HE
Hermes 2 Pro AlphaMonarch
Hermes · mitkox
Params7.24B
Context32K
Smallest7.7 GB
Tool use
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
ReasoningRoleplayTool use
HE
Hermes Dolphin out Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
hermes psy
Hermes · sim547
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
HE
hermes 2 pro entity cleaning gguf f16
Hermes · gutsartificial
Params7.24B
Context32K
Smallest14.5 GB
Tool use
HE
hermes dolphin 8B Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
hermes 3 tests gv
Hermes · gameversellc
Params3.21B
Context128K
Smallest1.9 GB
Tool use
HE
Hermes3 8b
Hermes · Inza124
Params8.03B
Context128K
Smallest4.7 GB
Tool use
HE
Hermes 4 14B
Hermes · tsorsdc
Params14.8B
Context40K
Smallest4.0 GB
ReasoningTool use
HE
hermes stheno 8B v0.1 Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
hermes test
Hermes · ConstantineMacris
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
hermes dolphin 8B v0.2 Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
hermes dolphin 8B v0.2 alt Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
Hermes3 3b
Hermes · Inza124
Params3.21B
Context128K
Smallest2.0 GB
Tool use
HE
hermes v1 round4
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
hermes v1 round1
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
hermes v1 round2
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
hermes v1 round3
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
hermes v1 round5
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
My_Hermes_Coder
Hermes · hammelfleisch
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use

Keep browsing