Bagel GGUF models

84 GGUF models in the Bagel family, quantized by 20 uploaders. Sizes run from 1.1B to 60.8B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
jondurbin/bagel-8b-v1.0
Bagel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BA
Bagel Dpo 34b v0.2
Bagel · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BA
bagel 8x7b v0.2
Bagel · ycros
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
BA
bagel 34b v0.2 iMat
Bagel · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BA
Bagel Dpo 34b v0.5
Bagel · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BA
Bagel Hermes 34B Slerp
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
Tool use
BA
Bagel Dpo 34b v0.2
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
CodingRoleplay
BA
bagel dpo 7b v0.1
Bagel · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
bagel 34b v0.4
Bagel · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplayTool use
BA
Bagel 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
CodingRoleplay
BA
Bagel Dpo 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
CodingRoleplay
BA
Bagel Dpo 8x7b v0.2
Bagel · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
BA
Bagel 7b v0.4
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bagel 7b v0.1
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
mamba bagel 2.8b GPU CPU v0.2
Bagel · kollecter
Params2.77B
Context1024K
Smallest2.0 GB
GGUF
BA
bagel dpo 7b v0.5
Bagel · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
BA
bagel jamba v05
Bagel · rAIfle
Params51.6B
Context256K
Q4_K_M31.6 GB
GGUF
BA
Bagel 34b v0.2
Bagel · RichardErkhov
Params34B
Context195K
Q4_K_M20.7 GB
GGUF
BA
bagel dpo 8x7b v0.2 iMat
Bagel · dranger003
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
BA
abacusai smaug 34B v0.1
Bagel · casualjim
Params34.4B
Context195K
Smallest28.2 GB
GGUF
BA
Bagel Hermes 2x34B
Bagel · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
Tool use
BA
bagel dpo 34b v0.2
Bagel · senseable
Params34.4B
Context195K
Smallest24.3 GB
GGUF
BA
bagel dpo 7b v0.1
Bagel · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bagel Dpo 7b v0.1
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing