Openbuddy GGUF models
84 GGUF models in the Openbuddy family, quantized by 15 uploaders. Sizes run from 2.81B to 72.7B parameters. The longest trained context is 195K tokens.
OP
OpenBuddy MuonQwen3 4B v27.1
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
OP
OpenBuddy R10528DistillQwen 14B v27.4 200K
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
OP
openbuddy zero 56b v21.2 32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
OP
Openbuddy R1 70b v24.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
OpenBuddy Zephyr 7B v14.1
Openbuddy · SinpxAI
Params7.28B
Context32K
Q4_K_M4.4 GB
OP
Openbuddy Openllama 7b v12
Openbuddy · tensorblock
Params6.78B
Context4K
Smallest2.6 GB
OP
Openbuddy Openllama 7b v12
Openbuddy · Cran-May
Params6.78B
Context4K
Smallest4.8 GB
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · MrDevolver
Params30.5B
Context195K
Smallest17.5 GB
OP
Openbuddy Llemma 34b v13.2
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
OP
openbuddy llemma 34b v13.1
Openbuddy · sprint-mammoth
Params33.8B
Context4K
Q4_K_M20.3 GB
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · OpenBuddy
Params30.5B
Context195K
Q4_K_M18.6 GB
OP
OpenBuddy openbuddy zero 56b v21.2 32k
Openbuddy · RichardErkhov
Params56.7B
Context128K
Smallest21.0 GB
OP
Openbuddy R1 70b v25.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
Openbuddy Llemma 34b v13.1
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · itlwas
Params34.4B
Context128K
Q4_K_M20.7 GB
OP
Openbuddy Openllama 7b v5 Fp16
Openbuddy · Cran-May
Params6.79B
Context2K
Smallest4.8 GB
OP
openbuddy-yi1.5-34b-v21.1-131k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
OP
openbuddy zephyr 7b.0
Openbuddy · elliotthwangmsa
Params7.28B
Context32K
Smallest5.2 GB
OP
Openbuddy Thinker 72b v25.1 200k
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
Openbuddy Thinker 14b v25.1
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
OP
openbuddy openllama 3b iq4nl
Openbuddy · Sashkanik13
Params3.46B
Context4K
Smallest2.0 GB
OP
Openbuddy Thinker 72b v25.1 200k
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
OP
Openbuddy R1 70b v25.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
OpenBuddy SpanishLanguageTeacher 7B Merged
Openbuddy · mradermacher
Params7.62B
Context195K
Q4_K_M4.7 GB