Breeze GGUF models

90 GGUF models in the Breeze family, quantized by 36 uploaders. Sizes run from 21M to 12.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BR
Breeze 7B 32k Base V1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 3b
Breeze · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
BR
Breeze 7B Instruct v1 0
Breeze · YC-Chen
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Instruct v1 0
Breeze · nold
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B FC V1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Cantonese v0.1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B FC V1_0
Breeze · yuuko-eth
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Instruct V0_1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Base_v1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze-ASR-26
Breeze · levirve
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
BR
mecha speech
Breeze · mecha-factory
Params2.85B
Context—
Smallest0.4 GB
GGUF
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze-7B-Instruct-v1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze-ASR-25
Breeze · epapanita
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
BR
Breeze 7B Base V0_1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Base V0_1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B FC V1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
WarmBreeze TTS 2
Breeze · marafx2007
Params—
Context—
Smallest3.9 GB
GGUF
BR
MediaTek Research Breeze 7B Instruct V1_0
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
GGUF
BR
Breeze 7B Instruct v0.1
Breeze · yuuko-eth
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Instruct 64k V0_1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze Petro 7B Instruct v1
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
Coding
BR
Breeze 7B Base v0.1
Breeze · audreyt
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B 32k Base V1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Base_v1_0
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
GGUF
BR
breeze 7B chinese biology chatbot
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B 32k Instruct V1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze 7B Base_v1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BR
Breeze-13B-32k-Base-v1_0
Breeze · mradermacher
Params12.7B
Context32K
Q4_K_M7.7 GB
GGUF
BR
Breeze 7B Instruct v0.1
Breeze · audreyt
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing