Jan GGUF models

96 GGUF models in the Jan family, quantized by 30 uploaders. Sizes run from 1.72B to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
JA
Jan Nano 128k Heretic
Jan · mradermacher
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan v1 4B
Jan · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan Nano NoThinkEmbed Jan Chat
Jan · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
EmbeddingReasoningTool use
JA
jan-v1-2509
Jan · janhq
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan v3 4B Base Instruct Heretic
Jan · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingTool use
JA
Jan-nano-128k
Jan · Mungert
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan v2 VL Max FP8
Jan · fuutott
Params30.5B
Context256K
Smallest17.3 GB
ReasoningTool useVision
JA
Janhq Jan v3 4B Base Instruct
Jan · aashish1904
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool use
JA
Menlo.Jan Nano
Jan · DevQuasar
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan Nano NoThinkEmbed
Jan · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
EmbeddingReasoningTool use
JA
Jan v3 4B Base Instruct
Jan · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingTool use
JA
Jan v1 2509
Jan · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan Nano
Jan · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
JA
jan hq komodo 7b chat
Jan · RichardErkhov
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
JA
Jan nano F32
Jan · prithivMLmods
Params4.02B
Context40K
Smallest8.1 GB
GGUF
JA
jan ai Solar 10.7B SLERP
Jan · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
JA
Jan v1 Edge
Jan · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
JA
jan hq Phoenix v1 8x7B
Jan · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
JA
Jan Pico 1.7B Thinking v0.2
Jan · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
JA
jan hq Yakult 70B
Jan · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
JA
Jan v2 VL Max FP8
Jan · maternion
Params30.5B
Context256K
Smallest32.5 GB
Vision
JA
Jan v2 VL Low
Jan · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
JA
Jan v1 Edge
Jan · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
JA
Jan Nano 128k Heretic
Jan · mradermacher
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan Pico 1.7B Thinking
Jan · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
JA
Jan Nano NoThinkEmbed
Jan · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
EmbeddingReasoningTool use
JA
Jan v3 4B Base Instruct Heretic
Jan · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingTool use
JA
jan ai Pandora 10.7B v1
Jan · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
JA
Jan Nano 128k
Jan · mradermacher
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan-v3-4b-base-instruct
Jan · kushagra909
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingTool use

Keep browsing