Hermes GGUF models
149 GGUF models in the Hermes family, quantized by 49 uploaders. Sizes run from 19M to 406B parameters. The longest trained context is 512K tokens.
HE
Hermes Instruct 7B 100K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes4 Philosopher Agent
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
Hermes 4 70B Heretic
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes Storm Climate Sauerkraut abliterated
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes-4-70B
Hermes · genevaquant
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes4.3 Z
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
conceptofmind_hermes-llongma-2-7b-8k
Hermes · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
HE
Hermes 7B TR
Hermes · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
HE
Hermes 4.3 36B ABLITERATED Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Hermes Storm lorablated i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes Instruct 7B 217K
Hermes · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes Instruct 7B 217K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes Instruct 7B 100K
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes 4.3 36B
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
Models NousResearch Hermes 4.3 36B
Hermes · MaziyarPanahi
Params36.2B
Context512K
Q4_K_M21.8 GB
HE
hermes stheno 8B v0.1 i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes 2 Pro French i1
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
NousResearch.Hermes 4 70B
Hermes · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes 4 14B
Hermes · genevaquant
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
Hermes 2 Pro 11B
Hermes · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
HE
Hermes Euryale 70B i1
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
Hermes2Yi 34B 40k
Hermes · mradermacher
Params34.4B
Context40K
Q4_K_M20.7 GB
HE
Hermes A1 20B
Hermes · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
HE
Hermes Storm Climate lorablated i1
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes 4 14B OBLITERATED
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
HE
hermes-Lexi-fun-stone-l3-8b
Hermes · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
Hermes3.5 2B Hermes v2
Hermes · keithlol
Params1.94B
Context256K
Smallest2.1 GB