GGUF models by enacimie

84 GGUF models quantized by enacimie on Hugging Face. Sizes run from 23M to 34.7B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 21B A3B PT
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
GGUF
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Smallest10.9 GB
ReasoningTool useVision
QW
Qwen2.5 7B Instruct 1M
Qwen · enacimie
Params7.62B
Context986K
Smallest3.0 GB
Tool use
QW
Qwen3 0.6B
Qwen · enacimie
Params752M
Context40K
Smallest0.3 GB
ReasoningTool use
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Smallest0.2 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · enacimie
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen2.5 7B Instruct 1M
Qwen · enacimie
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
ER
ERNIE 4.5 0.3B PT
Ernie · enacimie
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
FL
Flan T5 Small
Flan · enacimie
Params77M
Context512
Q4_K_M0.1 GB
Coding
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · enacimie
Params4.02B
Context256K
Smallest1.7 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · enacimie
Params135M
Context8K
Smallest0.1 GB
GGUF
VI
VibeThinker 1.5B
Vibethinker · enacimie
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
SM
T5 Small
Small · enacimie
Params61M
Context512
Q4_K_M0.0 GB
GGUF
NA
Nanbeige4 3B Base
Nanbeige · enacimie
Params3.93B
Context32K
Q4_K_M2.4 GB
GGUF
AL
all MiniLM L6 v2 Q4 K M
All · enacimie
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest3.8 GB
GGUF
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Smallest29.0 GB
ReasoningTool useVision
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest8.1 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · enacimie
Params21.8B
Context128K
Q4_K_M13.2 GB
ReasoningTool use
NA
Nanbeige4 3B Thinking 2511
Nanbeige · enacimie
Params3.93B
Context64K
Q4_K_M2.4 GB
ReasoningTool use
DI
DistillQwen ThoughtY 4B
Distillqwen · enacimie
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
WE
WebWatcher 7B
Webwatcher · enacimie
Params7.62B
Context125K
Smallest6.3 GB
GGUF
WE
WebSailor 7B
Websailor · enacimie
Params7.62B
Context32K
Smallest3.0 GB
Tool use

Keep browsing