Openbuddy GGUF models

84 GGUF models in the Openbuddy family, quantized by 15 uploaders. Sizes run from 2.81B to 72.7B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
OpenBuddy MuonQwen3 4B v27.1
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OP
OpenBuddy R10528DistillQwen 14B v27.4 200K
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
ReasoningTool use
OP
openbuddy zero 56b v21.2 32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
OP
Openbuddy R1 70b v24.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OP
OpenBuddy Zephyr 7B v14.1
Openbuddy · SinpxAI
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openbuddy Openllama 7b v12
Openbuddy · tensorblock
Params6.78B
Context4K
Smallest2.6 GB
GGUF
OP
Openbuddy Openllama 7b v12
Openbuddy · Cran-May
Params6.78B
Context4K
Smallest4.8 GB
GGUF
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · MrDevolver
Params30.5B
Context195K
Smallest17.5 GB
ReasoningTool use
OP
Openbuddy Llemma 34b v13.2
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
GGUF
OP
openbuddy llemma 34b v13.1
Openbuddy · sprint-mammoth
Params33.8B
Context4K
Q4_K_M20.3 GB
GGUF
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · OpenBuddy
Params30.5B
Context195K
Q4_K_M18.6 GB
ReasoningTool use
OP
OpenBuddy openbuddy zero 56b v21.2 32k
Openbuddy · RichardErkhov
Params56.7B
Context128K
Smallest21.0 GB
GGUF
OP
Openbuddy R1 70b v25.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OP
Openbuddy Llemma 34b v13.1
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
GGUF
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · itlwas
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
OP
Openbuddy Openllama 7b v5 Fp16
Openbuddy · Cran-May
Params6.79B
Context2K
Smallest4.8 GB
GGUF
OP
openbuddy-yi1.5-34b-v21.1-131k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
OP
openbuddy zephyr 7b.0
Openbuddy · elliotthwangmsa
Params7.28B
Context32K
Smallest5.2 GB
GGUF
OP
Openbuddy Thinker 72b v25.1 200k
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
Reasoning
OP
Openbuddy Thinker 14b v25.1
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
Reasoning
OP
openbuddy openllama 3b iq4nl
Openbuddy · Sashkanik13
Params3.46B
Context4K
Smallest2.0 GB
GGUF
OP
Openbuddy Thinker 72b v25.1 200k
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
Reasoning
OP
Openbuddy R1 70b v25.1
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OP
OpenBuddy SpanishLanguageTeacher 7B Merged
Openbuddy · mradermacher
Params7.62B
Context195K
Q4_K_M4.7 GB
GGUF

Keep browsing