GGUF models by enacimie
84 GGUF models quantized by enacimie on Hugging Face. Sizes run from 23M to 34.7B parameters. The longest trained context is 986K tokens.
ER
ERNIE 4.5 21B A3B PT
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Smallest10.9 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · enacimie
Params7.62B
Context986K
Smallest3.0 GB
QW
Qwen3 0.6B
Qwen · enacimie
Params752M
Context40K
Smallest0.3 GB
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Smallest0.2 GB
QW
Qwen2.5 0.5B Instruct
Qwen · enacimie
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · enacimie
Params7.62B
Context986K
Q4_K_M4.7 GB
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Q4_K_M0.2 GB
FL
Flan T5 Small
Flan · enacimie
Params77M
Context512
Q4_K_M0.1 GB
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3 4B Instruct 2507
Qwen · enacimie
Params4.02B
Context256K
Smallest1.7 GB
SM
SmolLM2 135M Instruct
SmolLM · enacimie
Params135M
Context8K
Smallest0.1 GB
VI
VibeThinker 1.5B
Vibethinker · enacimie
Params1.78B
Context128K
Q4_K_M1.1 GB
SM
T5 Small
Small · enacimie
Params61M
Context512
Q4_K_M0.0 GB
NA
Nanbeige4 3B Base
Nanbeige · enacimie
Params3.93B
Context32K
Q4_K_M2.4 GB
AL
all MiniLM L6 v2 Q4 K M
All · enacimie
Params23M
Context512
Q4_K_M0.0 GB
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest3.8 GB
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Smallest29.0 GB
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest8.1 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
NA
Nanbeige4 3B Thinking 2511
Nanbeige · enacimie
Params3.93B
Context64K
Q4_K_M2.4 GB
DI
DistillQwen ThoughtY 4B
Distillqwen · enacimie
Params4.02B
Context40K
Q4_K_M2.5 GB
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest6.3 GB
WE
WebSailor 7B
Websailor · enacimie
Params7.62B
Context32K
Smallest3.0 GB