Hermes GGUF models

149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
hermes fanfiction ft
Hermes · schneckepuff
Params3.21B
Context128K
Smallest6.4 GB
Tool use
HE
Hermes3 L3.1 DarkPlanetSF 8B i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes3 L3.1 DirtyHarry 8B i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 14B
Hermes · SandLogicTechnologies
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
HE
NousResearch_Hermes 4 405B
Hermes · lmstudio-community
Params406B
Context128K
Q4_K_M243.1 GB
ReasoningTool use
HE
Hermes4 Philosopher Agent
Hermes · mhaxscp
Params14.8B
Context40K
Smallest15.7 GB
ReasoningTool use
HE
hermes vision
Hermes · userzyzz
Params7.24B
Context32K
Smallest5.1 GB
Tool useVision
HE
Hermes
Hermes · lefantom00
Params8.03B
Context128K
Smallest5.7 GB
Tool use
HE
LTC AI Labs L2 7b Hermes WVG Test
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Tool use
HE
Hermes 4.3 36B
Hermes · gnigguhface
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
HE
Hermes 4.3 36B Heretic
Hermes · ThijsL202
Params36.2B
Context512K
Smallest29.7 GB
ReasoningRoleplayTool use
HE
hermes rp l2 7b
Hermes · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
GGUF
HE
Hermes 3 3B
Hermes · EasierAI
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
HE
Hermes3 L3.1 BigTalker 8B
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes3 L3.1 DarkPlanetSF 8B
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4.3 36B Heretic
Hermes · CrocoCpp
Params36.2B
Context512K
Smallest38.4 GB
ReasoningRoleplayTool use
HE
Hermes 4.3 36B
Hermes · FBTMAML
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
Hermes 4.3 36B
Hermes · gnigguhface
Params36.2B
Context512K
Smallest25.6 GB
ReasoningRoleplayTool use
HE
Hermes 2 Pro Ninja V3
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
HE
Hermes 4.3 36B Heretic
Hermes · SerialKicked
Params36.2B
Context512K
Smallest19.5 GB
ReasoningTool use
HE
UL3.3 Hermes X80 BASE 70B i1
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Hermes 4.3 36B
Hermes · EloyOn
Params36.2B
Context512K
Smallest25.0 GB
ReasoningRoleplayTool use
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
ReasoningRoleplayTool use
HE
Hermes 4 14B
Hermes · Gustav0-Freind
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
HE
juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B
Hermes · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
HE
Hermes GenBook 0.1 3B
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
HE
Hermes4.3 Z
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
HE
Hermes4.3 36B heretic bf16
Hermes · salamanderDixon
Params36.2B
Context512K
Smallest72.3 GB
ReasoningTool use
HE
Hermes 4 14B
Hermes · gnigguhface
Params14.8B
Context40K
Smallest15.7 GB
ReasoningRoleplayTool use
HE
Hermes Storm Climate Sauerkraut abliterated Q4 K M
Hermes · MotherEarth
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing