Hermes GGUF models
149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.
HE
hermes fanfiction ft
Hermes · schneckepuff
Params3.21B
Context128K
Smallest6.4 GB
HE
Hermes3 L3.1 DarkPlanetSF 8B i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes3 L3.1 DirtyHarry 8B i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes 4 14B
Hermes · SandLogicTechnologies
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
NousResearch_Hermes 4 405B
Hermes · lmstudio-community
Params406B
Context128K
Q4_K_M243.1 GB
HE
Hermes4 Philosopher Agent
Hermes · mhaxscp
Params14.8B
Context40K
Smallest15.7 GB
HE
hermes vision
Hermes · userzyzz
Params7.24B
Context32K
Smallest5.1 GB
HE
Hermes
Hermes · lefantom00
Params8.03B
Context128K
Smallest5.7 GB
HE
LTC AI Labs L2 7b Hermes WVG Test
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
HE
Hermes 4.3 36B
Hermes · gnigguhface
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Hermes 4.3 36B Heretic
Hermes · ThijsL202
Params36.2B
Context512K
Smallest29.7 GB
HE
hermes rp l2 7b
Hermes · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
HE
Hermes 3 3B
Hermes · EasierAI
Params3.21B
Context128K
Q4_K_M2.0 GB
HE
Hermes3 L3.1 BigTalker 8B
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes3 L3.1 DarkPlanetSF 8B
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes 4.3 36B Heretic
Hermes · CrocoCpp
Params36.2B
Context512K
Smallest38.4 GB
HE
Hermes 4.3 36B
Hermes · FBTMAML
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Hermes 4.3 36B
Hermes · gnigguhface
Params36.2B
Context512K
Smallest25.6 GB
HE
Hermes 2 Pro Ninja V3
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes 4.3 36B Heretic
Hermes · SerialKicked
Params36.2B
Context512K
Smallest19.5 GB
HE
UL3.3 Hermes X80 BASE 70B i1
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes 4.3 36B
Hermes · EloyOn
Params36.2B
Context512K
Smallest25.0 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
HE
Hermes 4 14B
Hermes · Gustav0-Freind
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B
Hermes · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
HE
Hermes GenBook 0.1 3B
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
HE
Hermes4.3 Z
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Hermes4.3 36B heretic bf16
Hermes · salamanderDixon
Params36.2B
Context512K
Smallest72.3 GB
HE
Hermes 4 14B
Hermes · gnigguhface
Params14.8B
Context40K
Smallest15.7 GB
HE
Hermes Storm Climate Sauerkraut abliterated Q4 K M
Hermes · MotherEarth
Params8.03B
Context128K
Q4_K_M4.9 GB