GGUF models by asura625

40 GGUF models quantized by asura625 on Hugging Face. Sizes run from 596M to 30.7B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
TP
tpn 004 c7
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
Tool use
TP
tpn 004 c6
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
Tool use
TP
tpn005 k12
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
Tool use
TP
tpn006 a5
Tpn · asura625
Params8.49B
Context256K
Smallest4.0 GB
Tool use
TP
tpn005 k15
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
Tool use
TP
tpn 004 c10
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
Tool use
TP
tpn005 k16
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
Tool use
TP
tpn 003 b
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
ReasoningTool use
TP
tpn 003 c
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
ReasoningTool use
CO
mt sn92 code front
Code · asura625
Params596M
Context40K
Smallest0.4 GB
CodingReasoningTool use
TP
tpn 002 q4ks
Tpn · asura625
Params8.95B
Context256K
Smallest5.4 GB
ReasoningTool use
TP
tpn 003 d
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
ReasoningTool use
TP
tpn 003 e
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
ReasoningTool use
AS
mt b4n8w2
Asura · asura625
Params596M
Context40K
Smallest0.4 GB
ReasoningTool use
TP
tpn 003 a
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
ReasoningTool use
CO
mt sn92 code front q6
Code · asura625
Params596M
Context40K
Smallest0.5 GB
CodingReasoningTool use
TP
tpn 002 hedge
Tpn · asura625
Params8.95B
Context256K
Smallest4.1 GB
ReasoningTool use
AS
mt x7k2p9
Asura · asura625
Params596M
Context40K
Smallest0.4 GB
ReasoningTool use
AS
mt c8k1r4
Asura · asura625
Params752M
Context40K
Smallest0.5 GB
ReasoningTool use
TP
tpn 002 q4km
Tpn · asura625
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
AS
mt c3v9y7
Asura · asura625
Params752M
Context40K
Smallest0.5 GB
ReasoningTool use

Keep browsing