GGUF models by asura625
40 GGUF models quantized by asura625 on Hugging Face. Sizes run from 596M to 30.7B parameters. The longest trained context is 256K tokens.
TP
tpn 004 c7
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
TP
tpn 004 c6
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
TP
tpn005 k12
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
TP
tpn006 a5
Tpn · asura625
Params8.49B
Context256K
Smallest4.0 GB
TP
tpn005 k15
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
TP
tpn 004 c10
Tpn · asura625
Params23.6B
Context128K
Smallest18.2 GB
TP
tpn005 k16
Tpn · asura625
Params8.49B
Context256K
Smallest7.2 GB
TP
tpn 003 b
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
TP
tpn 003 c
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
CO
mt sn92 code front
Code · asura625
Params596M
Context40K
Smallest0.4 GB
TP
tpn 002 q4ks
Tpn · asura625
Params8.95B
Context256K
Smallest5.4 GB
TP
tpn 003 d
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
TP
tpn 003 e
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
AS
mt b4n8w2
Asura · asura625
Params596M
Context40K
Smallest0.4 GB
TP
tpn 003 a
Tpn · asura625
Params11.9B
Context256K
Smallest8.8 GB
CO
mt sn92 code front q6
Code · asura625
Params596M
Context40K
Smallest0.5 GB
TP
tpn 002 hedge
Tpn · asura625
Params8.95B
Context256K
Smallest4.1 GB
AS
mt x7k2p9
Asura · asura625
Params596M
Context40K
Smallest0.4 GB
AS
mt c8k1r4
Asura · asura625
Params752M
Context40K
Smallest0.5 GB
TP
tpn 002 q4km
Tpn · asura625
Params8.95B
Context256K
Q4_K_M5.6 GB
AS
mt c3v9y7
Asura · asura625
Params752M
Context40K
Smallest0.5 GB