Openbuddy GGUF models
84 GGUF models in the Openbuddy family, quantized by 15 uploaders. Sizes run from 2.81B to 72.7B parameters. The longest trained context is 195K tokens.
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · gabriellarson
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
OpenBuddy MuonQwen3 4B v27 Base
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
OP
openbuddy zero 3b v21.2 32k i1
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
OP
OpenBuddy R10528DistillQwen 14B v27.1
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
OP
openbuddy zero 56b v21.2 32k i1
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
OP
OpenBuddy R10528Distill 30BA3B Preview1
Openbuddy · mradermacher
Params30.5B
Context195K
Q4_K_M18.6 GB
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · mradermacher
Params30.5B
Context195K
Q4_K_M18.6 GB
OP
OpenBuddy R10528DistillQwen 14B v27
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
OP
OpenBuddy R10528DistillQwen 4B v27.2
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
OP
openbuddy zero 3b v21.2 32k
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
OP
OpenBuddy openbuddy zero 3b v21.2 32k
Openbuddy · RichardErkhov
Params4.77B
Context32K
Q4_K_M3.0 GB
OP
openbuddy
Openbuddy · OpenBuddy
Params33.8B
Context32K
Smallest3.5 GB
OP
OpenBuddy R10528DistillQwen 14B v27.3 200K
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
OP
Openbuddy R1 32b v24.1
Openbuddy · mradermacher
Params32.8B
Context195K
Q4_K_M19.9 GB
OP
OpenBuddy R10528DistillQwen 72B Preview4
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
OpenBuddy MuonQwen3 4B v27 Base
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
OP
OpenBuddy R10528DistillQwen 72B Preview3 Abliterated
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
OpenBuddy R10528DistillQwen 72B Preview3
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
Openbuddy Thinker 70b v26 Preview
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
OP
Openbuddy Zephyr 7b v14.1
Openbuddy · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB
OP
Openbuddy Zen 3b v21.1 32k
Openbuddy · RichardErkhov
Params4.77B
Context32K
Q4_K_M3.0 GB
OP
openbuddy-yi1.5-34b-v21.1-131k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
OpenBuddy R10528DistillQwen 14B v27.2 LongCoTRL
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
OP
Openbuddy R1 67b v25.1
Openbuddy · mradermacher
Params67.4B
Context64K
Q4_K_M40.4 GB
OP
OpenBuddy R10528DistillQwen 4B v27.2
Openbuddy · Cran-May
Params4.02B
Context40K
Smallest2.9 GB
OP
Openbuddy Openllama 3b v10 Bf16
Openbuddy · Fadikkop
Params3.46B
Context4K
Smallest2.6 GB
OP
Openbuddy Wayfarer 70b v25.1 131k
Openbuddy · Cran-May
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
openbuddy-yi1.5-9b-v21.1-32k
Openbuddy · Cran-May
Params8.85B
Context32K
Smallest5.1 GB