Bonsai GGUF models
79 GGUF models in the Bonsai family, quantized by 55 uploaders. Sizes run from 6M to 27.3B parameters. The longest trained context is 256K tokens.
BO
bonsai image ternary 4B FLUX2 klein
Bonsai · Kuau
Params3.88B
Context—
Smallest1.4 GB
BO
Bonsai 1.7B requantized
Bonsai · lilyanatia
Params1.72B
Context32K
Smallest0.0 GB
BO
Bonsai 8B unpacked i1
Bonsai · mradermacher
Params8.19B
Context64K
Smallest0.0 GB
BO
Bonsai-27B
Bonsai · trychoosing
Params26.9B
Context256K
Smallest3.8 GB
BO
Bonsai-8B
Bonsai · Zlib2
Params8.19B
Context64K
Smallest1.2 GB
BO
Bonsai-27B
Bonsai · tokenbrew
Params26.9B
Context256K
Q4_K_M16.5 GB
BO
Bonsai 4B unpacked i1
Bonsai · mradermacher
Params4.02B
Context32K
Smallest0.0 GB
BO
Bonsai 8B unpacked
Bonsai · mradermacher
Params8.19B
Context64K
Smallest1.6 GB
BO
Bonsai-8B
Bonsai · PYTHAI
Params8.19B
Context64K
Smallest1.2 GB
BO
Bonsai 4B requantized
Bonsai · lilyanatia
Params4.02B
Context32K
Smallest0.0 GB
BO
Bonsai-4B
Bonsai · DavidBPunkt
Params4.02B
Context32K
Smallest0.6 GB
BO
Bonsai-8B
Bonsai · mayomacam
Params8.19B
Context64K
Smallest1.2 GB
BO
bonsai image binary 4B
Bonsai · biali
Params3.88B
Context—
Smallest0.8 GB
BO
Bonsai-1.7B
Bonsai · MrNAM205
Params1.72B
Context32K
Smallest0.2 GB
BO
Bonsai 8B BE
Bonsai · taronaeo
Params8.19B
Context64K
Smallest1.2 GB
BO
Bonsai 1.7B unpacked
Bonsai · mradermacher
Params1.72B
Context32K
Smallest0.5 GB
BO
bonsai 8b split
Bonsai · sinatras
Params8.19B
Context64K
Q4_K_M5.2 GB
BO
Bonsai 1.7B unpacked i1
Bonsai · mradermacher
Params1.72B
Context32K
Smallest0.0 GB
BO
Bonsai-8B
Bonsai · Torun00
Params8.19B
Context64K
Smallest1.2 GB
BO
Bonsai-4B
Bonsai · NoxNotreve
Params4.02B
Context32K
Smallest0.6 GB
BO
Bonsai-8B
Bonsai · jinreiyu
Params8.19B
Context64K
Smallest1.2 GB
BO
Bonsai-1.7B
Bonsai · BlackCubeBanditos
Params1.72B
Context32K
Smallest0.2 GB
BO
bonsai 1.7b split
Bonsai · sinatras
Params1.72B
Context32K
Q4_K_M1.1 GB
BO
Bonsai 4B unpacked
Bonsai · mradermacher
Params4.02B
Context32K
Smallest0.8 GB
BO
bonsai 4b split
Bonsai · sinatras
Params4.02B
Context32K
Q4_K_M2.5 GB
BO
prereleasetrainingpackage
Bonsai · ApacheOne
Params—
Context—
Smallest0.0 GB
BO
Bonsai-1.7B
Bonsai · Hagwell
Params1.72B
Context32K
Smallest0.2 GB
BO
Bonsai-27B
Bonsai · devendradhakad
Params26.9B
Context256K
Smallest3.8 GB
BO
Shiba Coder 27B Max
Bonsai · Gmartinezr
Params159M
Context—
Smallest0.3 GB
BO
Bonsai-8B
Bonsai · bakrianto
Params8.19B
Context64K
Smallest1.2 GB