Danube GGUF models

133 GGUF models in the Danube family, quantized by 35 uploaders. Sizes run from 514M to 3.96B parameters. The longest trained context is 16K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DA
H2O Danube3 500m Base
Danube · Wusul
Params514M
Context8K
Smallest0.5 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · mitulagr2
Params514M
Context8K
Smallest0.4 GB
GGUF
DA
h2o danube2 1.8b chat
Danube · skhatri
Params1.83B
Context8K
Smallest7.3 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.4 GB
GGUF
DA
Danube3 500m Turtle 2108
Danube · adamo1139
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · ijohn07
Params1.83B
Context8K
Smallest1.9 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · Felladrin
Params1.83B
Context8K
Smallest1.3 GB
GGUF
DA
H2O Danube3 4b Base
Danube · Wusul
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
h2o-danube-1.8b-chat
Danube · martintomov
Params1.83B
Context16K
Smallest1.9 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · Hongik-Project-2024
Params1.87B
Context2K
Smallest3.7 GB
GGUF
DA
Danube3 4b Hesoyam 2208 Gguf
Danube · adamo1139
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.3 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · Hongik-Project-2024
Params1.87B
Context2K
Smallest2.0 GB
GGUF

Keep browsing