Danube GGUF models

133 GGUF models in the Danube family, quantized by 35 uploaders. Sizes run from 514M to 3.96B parameters. The longest trained context is 16K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DA
H2O Danube2 1.8b Sft
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube 1.8b Base
Danube · tensorblock
Params1.83B
Context16K
Smallest0.7 GB
GGUF
DA
danube reasoner
Danube · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
H2O Danube3 500m Base
Danube · lobkov
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
h2o danube3 500m base
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
danube3-4B
Danube · BoscoTheDog
Params3.96B
Context8K
Q4_K_M4.8 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · Eytrigan
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · Edge-Quant
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
h2o-danube3-500m-base
Danube · NikolayKozloff
Params514M
Context8K
Smallest0.5 GB
GGUF
DA
H2O Danube2 1.8B Chat Q4 K M BE
Danube · librepowerai
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
h2o-danube3-4b-chat
Danube · martintomov
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.7 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Smallest3.3 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · ZeroWw
Params514M
Context8K
Smallest0.5 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.5 GB
GGUF
DA
h2o danube2 1.8b chat
Danube · chenhunghan
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · Felladrin
Params3.96B
Context8K
Smallest2.3 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.3 GB
GGUF
DA
h2o-danube3-4b-base
Danube · NikolayKozloff
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.3 GB
GGUF
DA
Danube3 500m Hesoyam 2108
Danube · adamo1139
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
Danube3 4b Aezakmi Toxic 2908
Danube · adamo1139
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
DA
h2o danube3 500m chat
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
DA
h2o-danube3-4b-base
Danube · martintomov
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DA
h2o danube2 1.8b chat Q6 K
Danube · newsletter
Params1.83B
Context8K
Smallest1.5 GB
GGUF
DA
danube reason x arco
Danube · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF

Keep browsing