GGUF models by enacimie

84 GGUF models quantized by enacimie on Hugging Face. Sizes run from 23M to 34.7B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
Tongyi DeepResearch 30B A3B
Tongyi · enacimie
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
OV
OvisOCR2
Ovisocr · enacimie
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
QW
Qwen3 Reranker 0.6B
Qwen · enacimie
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3 4B Instruct 2507
Qwen · enacimie
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LF
LFM2 VL 450M
Lfm · enacimie
Params354M
Context125K
Q4_K_M0.2 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · enacimie
Params8.19B
Context128K
Smallest6.6 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · enacimie
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
TA
UI TARS 7B DPO
Tars · enacimie
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
WE
WEBGEN 4B Preview
Webgen · enacimie
Params4.02B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3 0.6B
Qwen · enacimie
Params752M
Context40K
Smallest0.8 GB
ReasoningTool use
QW
Qwen3 VL 2B Instruct
Qwen · enacimie
Params1.72B
Context256K
Smallest0.9 GB
Tool useVision
QW
Qwen3.5 0.8B
Qwen · enacimie
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
AU
AutoGLM Phone 9B Multilingual
Autoglm · enacimie
Params9.4B
Context64K
Smallest10.0 GB
Vision
QW
Qwen3 VL 2B Instruct
Qwen · enacimie
Params1.72B
Context256K
Smallest0.9 GB
Tool useVision
WE
WebSailor 3B
Websailor · enacimie
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MA
Madlad400 10b Mt
Madlad · enacimie
Params10.7B
Context512
Q4_K_M6.7 GB
GGUF
AU
AutoGLM Phone 9B Multilingual
Autoglm · enacimie
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · enacimie
Params8.19B
Context128K
Smallest8.2 GB
ReasoningTool use
NA
Nanbeige4 3B Thinking 2511
Nanbeige · enacimie
Params3.93B
Context64K
Smallest4.2 GB
ReasoningTool use
TA
UI TARS 7B SFT
Tars · enacimie
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · enacimie
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen3.6 27B
Qwen · enacimie
Params27.3B
Context256K
Smallest22.4 GB
ReasoningTool useVision
AL
all MiniLM L6 v2 Q8 0
All · enacimie
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen3 Reranker 8B
Qwen · enacimie
Params8.19B
Context40K
Q4_K_M5.0 GB
EmbeddingReasoningTool use
NA
Nanbeige4 3B Base
Nanbeige · enacimie
Params3.93B
Context32K
Smallest4.2 GB
GGUF
LF
LFM2 350M
Lfm · enacimie
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
QW
Qwen3 Reranker 4B
Qwen · enacimie
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
ER
ERNIE 4.5 0.3B Base PT
Ernie · enacimie
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
WE
WebSailor 7B
Websailor · enacimie
Params7.62B
Context32K
Smallest4.4 GB
Tool use

Keep browsing