Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
test
Test · yy0607
Params8.03B
Context128K
Smallest8.5 GB
Tool use
TE
test quantizations
Test · langtech-innovation
Params7.77B
Context8K
Q4_K_M4.9 GB
GGUF
TE
test
Test · ThePun1sher
Params2.15B
Context—
Smallest1.3 GB
GGUF
TE
test142
Test · Sela223
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
test cache
Test · Rpo5777
Params39.1B
Context256K
Q4_K_M24.3 GB
ReasoningTool useVision
TE
test models
Test · meru
Params11.9B
Context128K
Smallest7.4 GB
ReasoningTool use
TE
test cachey
Test · Rpo5777
Params284B
Context1024K
Smallest98.8 GB
GGUF

Keep browsing