Zen GGUF models

83 GGUF models in the Zen family, quantized by 10 uploaders. Sizes run from 33M to 79.7B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
zen musician
Zen · mradermacher
Params6.22B
Context16K
Q4_K_M3.8 GB
GGUF
ZE
zen3 reranker medium
Zen · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
Embedding
ZE
Zen Eco Instruct
Zen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
ZE
Zen AI 3B Full
Zen · edusc182
Params3.09B
Context32K
Smallest2.5 GB
GGUF
ZE
zen3 reranker
Zen · mradermacher
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
ZE
Zen Nano 4b Thinking
Zen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ZE
Zen Nano 4b Instruct
Zen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ZE
zen3 reranker small
Zen · mradermacher
Params278M
Context512
Q4_K_M0.2 GB
Embedding
ZE
zen 4b
Zen · xysera
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
ZE
Zen 5 Coder
Zen · VibeManGeo
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingTool use
ZE
Zen 3B it
Zen · edusc182
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ZE
zen nano
Zen · Xlnk
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
ZE
Zen Nano 4b Thinking
Zen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ZE
zen vl 4b agent
Zen · RockMan256
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
ZE
zen vl 4b agent fullrc
Zen · RockMan256
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
ZE
zen vl 4b agent 45RC
Zen · RockMan256
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
ZE
zen vl 4b agent sm
Zen · RockMan256
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
ZE
zen3 reranker small gguf q4 k m
Zen · keisuke-miyako
Params278M
Context512
Q4_K_M0.2 GB
Embedding
ZE
zen3 reranker medium gguf q8 0
Zen · keisuke-miyako
Params560M
Context512
Smallest0.6 GB
Embedding
ZE
Zen Nano 4b Instruct
Zen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ZE
zen3 reranker gguf q4 k m
Zen · keisuke-miyako
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
ZE
zen3 reranker small gguf q8 0
Zen · keisuke-miyako
Params278M
Context512
Smallest0.3 GB
Embedding
ZE
zen3 reranker gguf q8 0
Zen · keisuke-miyako
Params568M
Context8K
Smallest0.6 GB
Embedding
ZE
zen3 reranker medium gguf q4 k m
Zen · keisuke-miyako
Params560M
Context512
Q4_K_M0.4 GB
Embedding

Keep browsing