Bonsai GGUF models

79 GGUF models in the Bonsai family, quantized by 55 uploaders. Sizes run from 6M to 27.3B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BO
bonsai image ternary 4B FLUX2 klein
Bonsai · Kuau
Params3.88B
Context—
Smallest1.4 GB
GGUF
BO
Bonsai 1.7B requantized
Bonsai · lilyanatia
Params1.72B
Context32K
Smallest0.0 GB
GGUF
BO
Bonsai 8B unpacked i1
Bonsai · mradermacher
Params8.19B
Context64K
Smallest0.0 GB
GGUF
BO
Bonsai-27B
Bonsai · trychoosing
Params26.9B
Context256K
Smallest3.8 GB
ReasoningTool useVision
BO
Bonsai-8B
Bonsai · Zlib2
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use
BO
Bonsai-27B
Bonsai · tokenbrew
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
BO
Bonsai 4B unpacked i1
Bonsai · mradermacher
Params4.02B
Context32K
Smallest0.0 GB
GGUF
BO
Bonsai 8B unpacked
Bonsai · mradermacher
Params8.19B
Context64K
Smallest1.6 GB
ReasoningTool use
BO
Bonsai-8B
Bonsai · PYTHAI
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use
BO
Bonsai 4B requantized
Bonsai · lilyanatia
Params4.02B
Context32K
Smallest0.0 GB
GGUF
BO
Bonsai-4B
Bonsai · DavidBPunkt
Params4.02B
Context32K
Smallest0.6 GB
ReasoningTool use
BO
Bonsai-8B
Bonsai · mayomacam
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use
BO
bonsai image binary 4B
Bonsai · biali
Params3.88B
Context—
Smallest0.8 GB
GGUF
BO
Bonsai-1.7B
Bonsai · MrNAM205
Params1.72B
Context32K
Smallest0.2 GB
ReasoningTool use
BO
Bonsai 8B BE
Bonsai · taronaeo
Params8.19B
Context64K
Smallest1.2 GB
GGUF
BO
Bonsai 1.7B unpacked
Bonsai · mradermacher
Params1.72B
Context32K
Smallest0.5 GB
ReasoningTool use
BO
bonsai 8b split
Bonsai · sinatras
Params8.19B
Context64K
Q4_K_M5.2 GB
GGUF
BO
Bonsai 1.7B unpacked i1
Bonsai · mradermacher
Params1.72B
Context32K
Smallest0.0 GB
GGUF
BO
Bonsai-8B
Bonsai · Torun00
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use
BO
Bonsai-4B
Bonsai · NoxNotreve
Params4.02B
Context32K
Smallest0.6 GB
ReasoningTool use
BO
Bonsai-8B
Bonsai · jinreiyu
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use
BO
Bonsai-1.7B
Bonsai · BlackCubeBanditos
Params1.72B
Context32K
Smallest0.2 GB
ReasoningTool use
BO
bonsai 1.7b split
Bonsai · sinatras
Params1.72B
Context32K
Q4_K_M1.1 GB
GGUF
BO
Bonsai 4B unpacked
Bonsai · mradermacher
Params4.02B
Context32K
Smallest0.8 GB
ReasoningTool use
BO
bonsai 4b split
Bonsai · sinatras
Params4.02B
Context32K
Q4_K_M2.5 GB
GGUF
BO
prereleasetrainingpackage
Bonsai · ApacheOne
Params—
Context—
Smallest0.0 GB
GGUF
BO
Bonsai-1.7B
Bonsai · Hagwell
Params1.72B
Context32K
Smallest0.2 GB
ReasoningTool use
BO
Bonsai-27B
Bonsai · devendradhakad
Params26.9B
Context256K
Smallest3.8 GB
ReasoningTool useVision
BO
Shiba Coder 27B Max
Bonsai · Gmartinezr
Params159M
Context—
Smallest0.3 GB
GGUF
BO
Bonsai-8B
Bonsai · bakrianto
Params8.19B
Context64K
Smallest1.2 GB
ReasoningTool use

Keep browsing