Bagel GGUF models

84 GGUF models in the Bagel family, quantized by 20 uploaders. Sizes run from 1.1B to 60.8B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
jondurbin_bagel-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingRoleplay
BA
jondurbin_bagel-dpo-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
BA
jondurbin_bagel-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
BA
Bagel Dpo 1.1b v0.3
Bagel · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
CodingRoleplay
BA
Bagel Dpo 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
BA
bagel dpo 8x7b v0.2
Bagel · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
GGUF
BA
Bagel Hermes 34B Slerp i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Tool use
BA
Bagel Dpo 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
BA
Bagel Dpo 7b v0.4
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
BA
Smaug 34B v0.1
Bagel · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BA
Bagel 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
BA
jondurbin_bagel-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
BA
Bagel 34b v0.2
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
BA
Bagel Dpo 7b v0.1
Bagel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
BA
jondurbin/bagel-dpo-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
bagel dpo 7b v0.4
Bagel · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
BA
Bagel Hermes 34B Slerp
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Tool use
BA
jondurbin/bagel-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bagel 7b v0.1
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
BA
jondurbin/bagel-dpo-1.1b-v0.3
Bagel · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BA
Bagel Dpo 7b v0.5
Bagel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
bagel dpo 34b v0.5 iMat
Bagel · dranger003
Params34.4B
Context195K
Smallest10.3 GB
GGUF
BA
bagel dpo 34b v0.2
Bagel · ycros
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BA
Bagel Dpo 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
BA
bagel dpo 7b v0.4
Bagel · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bagel 8x7b v0.2
Bagel · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
BA
Bagel 7b v0.4
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
BA
Bagel 1.1b v0.3
Bagel · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
CodingRoleplay
BA
Bagel Hermes 2x34B
Bagel · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
Tool use
BA
bagel-2.8b-v0.2
Bagel · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
GGUF

Keep browsing