Ernie GGUF models

118 GGUF models in the Ernie family, quantized by 52 uploaders. Sizes run from 11M to 300B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 21B A3B APEX
Ernie · Myric
Params21.8B
Context128K
Smallest11.2 GB
GGUF
ER
Ernie Image Flex V1
Ernie · wikeeyang
Params8.03B
Context—
Smallest9.1 GB
GGUF
ER
Ernie_4.5_Nelsuh
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · dengcao
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
Ernie-4.5-21B-A3B-Pt
Ernie · noctrex
Params21.8B
Context128K
Smallest12.4 GB
GGUF
ER
ERNIE 4.5 300B A47B PT
Ernie · lmstudio-community
Params299B
Context128K
Q4_K_M181.8 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking Gemini 2.5 Pro Distill F16
Ernie · Liontix
Params21.8B
Context128K
Smallest10.5 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B
Ernie · yasserrmd
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE Image Turbo
Ernie · chuxing899
Params8.03B
Context—
Q4_K_M5.0 GB
GGUF
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · Dagowina
Params21.8B
Context128K
Smallest17.9 GB
Reasoning
ER
ernie 4.5 a3b 21b thinking
Ernie · AmpereComputing
Params21.8B
Context128K
Smallest22.0 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B Base BF16
Ernie · ahBeyond
Params361M
Context128K
Smallest0.7 GB
Coding
ER
ERNIE 21B A3B Thinking Gemini 3 Pro High Reasoning V2
Ernie · jtjones
Params21.8B
Context128K
Smallest17.9 GB
Reasoning
ER
Hexo 0.5 Nano Experimental
Ernie · LegoKeeper
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest8.1 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest10.5 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · Edge-Quant
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · noctrex
Params21.8B
Context128K
Smallest12.4 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B Thinking
Ernie · guodayang
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · LukeSTR
Params361M
Context128K
Smallest0.4 GB
GGUF
ER
ERNIE 4.5 21B A3B Base PT
Ernie · dengcao
Params22.1B
Context128K
Q4_K_M13.4 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest9.5 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · MarzLars
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B Base PT
Ernie · enacimie
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · MarzLars
Params361M
Context128K
Smallest0.2 GB
GGUF
ER
Ernie Prompt Enhancer
Ernie · grocerystoreride
Params11M
Context256K
Smallest0.0 GB
GGUF
ER
ERNIE 21B REAP GGUFS
Ernie · jerrimu
Params18B
Context128K
Smallest6.7 GB
GGUF
ER
ERNIE 4.5 21B A3B PT
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · ownia
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B PT
Ernie · ERNIE-Community
Params43B
Context128K
Smallest45.7 GB
ReasoningVision

Keep browsing