Hermes GGUF models
149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.
HE
Hermes 4 14B BF16 Abliterated
Hermes · n0kovo
Params14.8B
Context40K
Smallest15.7 GB
HE
Hermes 4 14B
Hermes · ignyse
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
Hermes Synthia 7B
Hermes · Lazycuber
Params6.74B
Context4K
Smallest7.2 GB
HE
UL3.3 Hermes X80 BASE 70B
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes 2 Pro Ninja V3
Hermes · NON906
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
hermes gguf vault
Hermes · Allell85
Params1.24B
Context128K
Q4_K_M0.8 GB
HE
Hermes-4-70B
Hermes · Bluerosesbutterfly
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes 2 Pro French
Hermes · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
HE
Hermes 3 Remix L3.2 3b
Hermes · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
HE
Hermes 2 Pro AlphaMonarch
Hermes · mitkox
Params7.24B
Context32K
Smallest7.7 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
HE
Hermes Dolphin out Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
HE
hermes psy
Hermes · sim547
Params3.21B
Context128K
Q4_K_M2.0 GB
HE
hermes 2 pro entity cleaning gguf f16
Hermes · gutsartificial
Params7.24B
Context32K
Smallest14.5 GB
HE
hermes dolphin 8B Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
HE
hermes 3 tests gv
Hermes · gameversellc
Params3.21B
Context128K
Smallest1.9 GB
HE
Hermes3 8b
Hermes · Inza124
Params8.03B
Context128K
Smallest4.7 GB
HE
Hermes 4 14B
Hermes · tsorsdc
Params14.8B
Context40K
Smallest4.0 GB
HE
hermes stheno 8B v0.1 Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
HE
hermes test
Hermes · ConstantineMacris
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
hermes dolphin 8B v0.2 Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
HE
hermes dolphin 8B v0.2 alt Q5 K M
Hermes · harkov000
Params8.03B
Context128K
Smallest5.7 GB
HE
Hermes3 3b
Hermes · Inza124
Params3.21B
Context128K
Smallest2.0 GB
HE
hermes v1 round4
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
hermes v1 round1
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
hermes v1 round2
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
hermes v1 round3
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
hermes v1 round5
Hermes · danrichard6tyt
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
My_Hermes_Coder
Hermes · hammelfleisch
Params3.09B
Context32K
Q4_K_M1.9 GB