Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
test
Test · congqi
Params370M
Context32K
Smallest0.3 GB
GGUF
TE
test
Test · TianYiRuCi
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · HHSWSW
Params3.21B
Context128K
Smallest3.4 GB
Tool use
TE
test
Test · bmcgroup
Params14.3B
Context—
Smallest12.0 GB
GGUF
TE
test
Test · mrod9
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
test
Test · qwehoi67
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
mergekit dare linear xaazcaj Q5 K M
Test · djuna
Params8.03B
Context128K
Smallest5.7 GB
GGUF
TE
mergekit della linear qaxucjoo Q5 K M
Test · djuna
Params8.03B
Context128K
Smallest5.7 GB
GGUF
TE
test2
Test · sweetpapa
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test
Test · satviksrivas7
Params1.24B
Context128K
Smallest0.9 GB
Tool use
TE
7b test4 gguf q8 0
Test · hellsk
Params6.74B
Context4K
Smallest7.2 GB
GGUF
TE
7b test3 gguf f16
Test · hellsk
Params6.74B
Context4K
Smallest13.5 GB
GGUF
TE
7b test4 gguf f16
Test · hellsk
Params6.74B
Context4K
Smallest13.5 GB
GGUF
TE
test
Test · linjimzen
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
Test_Honest Serenity 73
Test · hendrik-spl
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TE
Test Model 22
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
TE
test model files
Test · Priyanshi52
Params—
Context—
Smallest0.0 GB
GGUF
TE
test101
Test · dhananjayanjali
Params6.74B
Context4K
Smallest13.5 GB
GGUF
TE
test2
Test · ElijahBare
Params—
Context—
Smallest0.0 GB
GGUF
TE
test
Test · C10X
Params752M
Context256K
Smallest0.8 GB
ReasoningTool use
TE
test
Test · Yaris12312
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Test2_3
Test · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TE
Test Model
Test · Tinomar
Params1M
Context—
Smallest0.0 GB
GGUF
TE
test
Test · woolfie1101
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
Test68
Test · rain0111
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test lora
Test · hmuegyi
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
Test10
Test · gR72025
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test
Test · mark76
Params8.19B
Context128K
Smallest8.7 GB
GGUF
TE
test85
Test · sfminho
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
TE
test sjb
Test · sjb0214
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use

Keep browsing