Ernie GGUF models

118 GGUF models in the Ernie family, quantized by 52 uploaders. Sizes run from 11M to 300B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 37B A3B Thinking Brainstorm20x
Ernie · mradermacher
Params37.2B
Context128K
Q4_K_M22.5 GB
CodingReasoningTool use
ER
baidu.ERNIE 4.5 0.3B PT
Ernie · DevQuasar
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE Image GGUF Base Turbo
Ernie · vantagewithai
Params8.03B
Context—
Q4_K_M5.1 GB
GGUF
ER
ERNIE-4.5-0.3B-PT
Ernie · Mungert
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
baidu.ERNIE 4.5 21B A3B Thinking
Ernie · DevQuasar
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B Thinking
Ernie · gabriellarson
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B PT
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE 4.5 29B A4B PT
Ernie · mradermacher
Params29B
Context128K
Q4_K_M17.5 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE Image Turbo
Ernie · Solictous
Params8.03B
Context—
Smallest5.1 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · mmnga
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B Math CoT
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B Distilled
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 21B A3B Thinking Gemini 3 Pro High Reasoning V2
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 21B REAP
Ernie · mradermacher
Params18B
Context128K
Q4_K_M10.9 GB
GGUF
ER
ERNIE 4.5 21B A3B Base PT Heretic
Ernie · filvyb
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
baidu.ERNIE 4.5 21B A3B Base PT
Ernie · DevQuasar
Params22.1B
Context128K
Q4_K_M13.4 GB
GGUF
ER
ERNIE 4.5 0.3B Base PT
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B Math
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
baidu.ERNIE 4.5 0.3B Base PT
Ernie · dengcao
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B PT Adv
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERINE 4.5 0.3B Yue
Ernie · mradermacher
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE Image
Ernie · Solictous
Params8.03B
Context—
Smallest0.2 GB
GGUF
ER
Ernie-4.5-0.3B-Pt
Ernie · Dc15er
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B Thinking F16
Ernie · ERNIE-Community
Params28.6B
Context128K
Smallest1.6 GB
GGUF
ER
ERNIE 4.5 300B A47B PT
Ernie · gabriellarson
Params299B
Context128K
Q4_K_M180.2 GB
GGUF
ER
baidu/ERNIE-4.5-21B-A3B-PT
Ernie · ilintar
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE Image Turbo
Ernie · Kle1nee
Params8.03B
Context—
Q4_K_M5.0 GB
GGUF
ER
ERNIE Image Turbo iOS
Ernie · jc-builds
Params8.03B
Context256K
Q4_K_M2.1 GB
GGUF

Keep browsing