Bagel GGUF models
84 GGUF models in the Bagel family, quantized by 20 uploaders. Sizes run from 1.1B to 60.8B parameters. The longest trained context is 1024K tokens.
BA
jondurbin_bagel-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
BA
jondurbin_bagel-dpo-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
jondurbin_bagel-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 1.1b v0.3
Bagel · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BA
Bagel Dpo 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
bagel dpo 8x7b v0.2
Bagel · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
BA
Bagel Hermes 34B Slerp i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 7b v0.4
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Smaug 34B v0.1
Bagel · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
jondurbin_bagel-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 7b v0.1
Bagel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
BA
jondurbin/bagel-dpo-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
bagel dpo 7b v0.4
Bagel · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel Hermes 34B Slerp
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
jondurbin/bagel-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel 7b v0.1
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
jondurbin/bagel-dpo-1.1b-v0.3
Bagel · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
BA
Bagel Dpo 7b v0.5
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
bagel dpo 34b v0.5 iMat
Bagel · dranger003
Params34.4B
Context195K
Smallest10.3 GB
BA
bagel dpo 34b v0.2
Bagel · ycros
Params34.4B
Context195K
Q4_K_M20.7 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
bagel dpo 7b v0.4
Bagel · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
BA
Bagel 7b v0.4
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bagel 1.1b v0.3
Bagel · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BA
Bagel Hermes 2x34B
Bagel · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
BA
bagel-2.8b-v0.2
Bagel · dranger003
Params2.77B
Context1024K
Smallest2.0 GB