Danube GGUF models

133 GGUF models in the Danube family, quantized by 35 uploaders. Sizes run from 514M to 3.96B parameters. The longest trained context is 16K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DA
H2O Danube3 500m Chat
Danube · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
danube2 upscale 1.7 i1
Danube · mradermacher
Params2.25B
Context8K
Q4_K_M1.4 GB
Roleplay
DA
H2O Danube3 4b Base
Danube · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
danube2-1.8b-MathInstruct
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · RichardErkhov
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · RichardErkhov
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
gguf h2o danube2 1.8b chat
Danube · Felladrin
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube2 1.8b Base
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · tensorblock
Params1.87B
Context2K
Smallest0.7 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · mradermacher
Params1.87B
Context2K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · RichardErkhov
Params1.87B
Context2K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube2 1.8b Sft
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · RichardErkhov
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
H2O Danube 1.8b Sft
Danube · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.7 GB
GGUF
DA
h2o danube 1.8b chat
Danube · brittlewis12
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube3 4b Base
Danube · RichardErkhov
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
h2o-danube-1.8b-sft
Danube · RichardErkhov
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
DA
Danube3 4b 4chan HESOYAM 2510
Danube · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube 1.8b Chat
Danube · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · tensorblock
Params3.96B
Context8K
Smallest1.5 GB
GGUF
DA
Danube3 4b Turtle 2208 Gguf
Danube · adamo1139
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
danube2-1.8b-airoboros-3.2
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
h2o danube3 4b chat
Danube · DevQuasar-4
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
danube2 upscale 1
Danube · mradermacher
Params2.25B
Context8K
Q4_K_M1.4 GB
GGUF
DA
danube2-1.8b-Code-290k
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Coding

Keep browsing