Ernie GGUF models

118 GGUF models in the Ernie family, quantized by 52 uploaders. Sizes run from 11M to 300B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 0.3B PT
Ernie · wqerrewetw
Params361M
Context128K
Smallest0.7 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Smallest0.2 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B Thinking
Ernie · ERNIE-Community
Params43.2B
Context128K
Smallest12.1 GB
ReasoningTool useVision
ER
ERNIE 4.5 21B A3B Thinking
Ernie · guodayang
Params21.8B
Context128K
Smallest23.2 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · NikolayKozloff
Params361M
Context128K
Smallest0.4 GB
GGUF
ER
ERNIE 4.5 21B A3B PT
Ernie · qurk41
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B Thinking
Ernie · ERNIE-Community
Params43.2B
Context128K
Smallest10.1 GB
ReasoningTool useVision
ER
ERNIE 4.5 21B A3B Thinking
Ernie · MrMeOrYou
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B Thinking
Ernie · kkioikk
Params21.8B
Context128K
Smallest9.5 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
ER
ernie45 21b a3b base
Ernie · darthceltic85
Params21.8B
Context128K
Smallest23.2 GB
GGUF
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · lovedheart
Params21.8B
Context128K
Smallest7.7 GB
ReasoningTool use
ER
ERNIE 4.5 VL 28B A3B PT
Ernie · ERNIE-Community
Params43B
Context128K
Smallest11.6 GB
ReasoningVision
ER
ERNIE 4.5 VL 28B A3B Thinking
Ernie · ERNIE-Community
Params43.2B
Context128K
Smallest173.0 GB
ReasoningTool useVision
ER
ERNIE 4.5 VL 28B A3B PT
Ernie · ERNIE-Community
Params43B
Context128K
Smallest86.0 GB
ReasoningVision
ER
ERNIE 4.5 21B A3B PT
Ernie · zdchen
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B Thinking
Ernie · ERNIE-Community
Params43.2B
Context128K
Smallest46.0 GB
ReasoningTool useVision
ER
Ernie-4.5-21B-A3B-Pt
Ernie · dengcao
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
ER
Ernie Unsloth Saved Finetune
Ernie · Ba2han
Params21.8B
Context128K
Smallest17.9 GB
GGUF
ER
ERNIE 4.5 VL 28B A3B PT
Ernie · ERNIE-Community
Params43B
Context128K
Smallest86.0 GB
ReasoningVision
ER
ERNIE 4.5 21B A3B Thinking
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 VL 28B A3B PT
Ernie · ERNIE-Community
Params43B
Context128K
Smallest9.6 GB
ReasoningVision
ER
ERNIE 4.5 VL 28B A3B Thinking
Ernie · ERNIE-Community
Params43.2B
Context128K
Smallest86.5 GB
ReasoningTool useVision
ER
ERNIE 4.5 21B A3B Thinking
Ernie · wekW
Params21.8B
Context128K
Smallest23.2 GB
ReasoningTool use
ER
Ernie Unsloth Saved Finetune
Ernie · Ba2han
Params21.8B
Context128K
Smallest15.1 GB
GGUF
ER
ERNIE 4.5 21B A3B PT
Ernie · irmma
Params21.8B
Context128K
Smallest12.4 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · Tobivictor
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B Base
Ernie · shixin-labs
Params361M
Context128K
Smallest0.4 GB
GGUF

Keep browsing