Bagel GGUF models
84 GGUF models in the Bagel family, quantized by 20 uploaders. Sizes run from 1.1B to 60.8B parameters. The longest trained context is 1024K tokens.
BA
jondurbin/bagel-8b-v1.0
Bagel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
Bagel Dpo 34b v0.2
Bagel · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
bagel 8x7b v0.2
Bagel · ycros
Params46.7B
Context32K
Q4_K_M26.4 GB
BA
bagel 34b v0.2 iMat
Bagel · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 34b v0.5
Bagel · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Hermes 34B Slerp
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
BA
Bagel Dpo 34b v0.2
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
BA
bagel dpo 7b v0.1
Bagel · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
bagel 34b v0.4
Bagel · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
Bagel 7b v0.4
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel 7b v0.1
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
mamba bagel 2.8b GPU CPU v0.2
Bagel · kollecter
Params2.77B
Context1024K
Smallest2.0 GB
BA
bagel dpo 7b v0.5
Bagel · cstr
Params7.24B
Context32K
Smallest4.4 GB
BA
bagel jamba v05
Bagel · rAIfle
Params51.6B
Context256K
Q4_K_M31.6 GB
BA
Bagel 34b v0.2
Bagel · RichardErkhov
Params34B
Context195K
Q4_K_M20.7 GB
BA
bagel dpo 8x7b v0.2 iMat
Bagel · dranger003
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
abacusai smaug 34B v0.1
Bagel · casualjim
Params34.4B
Context195K
Smallest28.2 GB
BA
Bagel Hermes 2x34B
Bagel · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
BA
bagel dpo 34b v0.2
Bagel · senseable
Params34.4B
Context195K
Smallest24.3 GB
BA
bagel dpo 7b v0.1
Bagel · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel Dpo 7b v0.1
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB