Openbuddy GGUF models

84 GGUF models in the Openbuddy family, quantized by 15 uploaders. Sizes run from 2.81B to 72.7B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · gabriellarson
Params72.7B
Context195K
Q4_K_M47.4 GB
ReasoningTool use
OP
OpenBuddy MuonQwen3 4B v27 Base
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OP
openbuddy zero 3b v21.2 32k i1
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
GGUF
OP
OpenBuddy R10528DistillQwen 14B v27.1
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OP
openbuddy zero 56b v21.2 32k i1
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
OP
OpenBuddy R10528Distill 30BA3B Preview1
Openbuddy · mradermacher
Params30.5B
Context195K
Q4_K_M18.6 GB
ReasoningTool use
OP
OpenBuddy R10528Distill 30BA3B Preview2
Openbuddy · mradermacher
Params30.5B
Context195K
Q4_K_M18.6 GB
ReasoningTool use
OP
OpenBuddy R10528DistillQwen 14B v27
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OP
OpenBuddy R10528DistillQwen 4B v27.2
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OP
openbuddy zero 3b v21.2 32k
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
GGUF
OP
OpenBuddy openbuddy zero 3b v21.2 32k
Openbuddy · RichardErkhov
Params4.77B
Context32K
Q4_K_M3.0 GB
GGUF
OP
openbuddy
Openbuddy · OpenBuddy
Params33.8B
Context32K
Smallest3.5 GB
GGUF
OP
OpenBuddy R10528DistillQwen 14B v27.3 200K
Openbuddy · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
GGUF
OP
Openbuddy R1 32b v24.1
Openbuddy · mradermacher
Params32.8B
Context195K
Q4_K_M19.9 GB
Reasoning
OP
OpenBuddy R10528DistillQwen 72B Preview4
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
ReasoningTool use
OP
OpenBuddy MuonQwen3 4B v27 Base
Openbuddy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OP
OpenBuddy R10528DistillQwen 72B Preview3 Abliterated
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
ReasoningTool use
OP
OpenBuddy R10528DistillQwen 72B Preview3
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
ReasoningTool use
OP
Openbuddy Thinker 70b v26 Preview
Openbuddy · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
GGUF
OP
Openbuddy Zephyr 7b v14.1
Openbuddy · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openbuddy Zen 3b v21.1 32k
Openbuddy · RichardErkhov
Params4.77B
Context32K
Q4_K_M3.0 GB
GGUF
OP
openbuddy-yi1.5-34b-v21.1-131k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · mradermacher
Params72.7B
Context195K
Q4_K_M47.4 GB
ReasoningTool use
OP
OpenBuddy R10528DistillQwen 14B v27.2 LongCoTRL
Openbuddy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OP
Openbuddy R1 67b v25.1
Openbuddy · mradermacher
Params67.4B
Context64K
Q4_K_M40.4 GB
Reasoning
OP
OpenBuddy R10528DistillQwen 4B v27.2
Openbuddy · Cran-May
Params4.02B
Context40K
Smallest2.9 GB
ReasoningTool use
OP
Openbuddy Openllama 3b v10 Bf16
Openbuddy · Fadikkop
Params3.46B
Context4K
Smallest2.6 GB
GGUF
OP
Openbuddy Wayfarer 70b v25.1 131k
Openbuddy · Cran-May
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OP
openbuddy-yi1.5-9b-v21.1-32k
Openbuddy · Cran-May
Params8.85B
Context32K
Smallest5.1 GB
GGUF

Keep browsing