Jan GGUF models

96 GGUF models in the Jan family, quantized by 30 uploaders. Sizes run from 1.72B to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
JA
Jan Nano
Jan · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use
JA
Jan nano orig
Jan · jan-hq
Params4.02B
Context40K
Smallest8.1 GB
ReasoningTool use
JA
jan security research poc
Jan · orenyomtov
Params—
Context—
Smallest0.0 GB
GGUF
JA
Jan-v3.5-4B
Jan · KhanhDu
Params4.41B
Context256K
Smallest2.1 GB
Tool use
JA
Fikr Code v1
Jan · TheDevil123456789
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
JA
Jan v1 4B
Jan · Tobivictor
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use

Keep browsing