Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
Yi Ko 6B
Test · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
TE
test llm colab
Test · bearhuang
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test 5
Test · BICORP
Params338M
Context—
Smallest1.4 GB
GGUF
TE
my test2 model2
Test · AX1Y2JP
Params11.9B
Context—
Smallest12.7 GB
GGUF
TE
test
Test · gpopmescu
Params8.03B
Context8K
Smallest8.5 GB
GGUF
TE
test
Test · Aitrepreneur
Params20.4B
Context—
Smallest10.6 GB
GGUF
TE
test
Test · changjunlee
Params2.03B
Context32K
Q4_K_M1.3 GB
ReasoningTool use
TE
3 test q8
Test · Ak1104
Params8.03B
Context8K
Smallest8.5 GB
GGUF
TE
test upload
Test · nathan-weinberg
Params6.74B
Context512
Q4_K_M0.0 GB
GGUF
TE
test gguf 2
Test · TenzinGayche
Params9.24B
Context8K
Smallest37.0 GB
GGUF
TE
test train on responses gguf 2 epochs
Test · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
Test 24B v1a
Test · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
TE
TEST Magidonia 24B v4.3 creative ORPO v5.1
Test · WarlordHermes
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
TE
test long write model
Test · fengyunhai
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
TE
Test Cute Gguf
Test · NaruseShiroha
Params8.95B
Context256K
Smallest5.6 GB
ReasoningTool use
TE
TEST Q2.5 AA Q8 0
Test · djuna
Params8.78B
Context128K
Smallest9.3 GB
GGUF
TE
test ollama
Test · ahmed4421
Params8.03B
Context128K
Smallest16.1 GB
GGUF
TE
test
Test · yandt
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test train on responses gguf 3b
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
ft_test_GGUF
Test · joeyderrrr
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test01
Test · kimscom
Params3.21B
Context128K
Smallest3.4 GB
GGUF
TE
Test Unsloth Multispeaker Larger
Test · NescIO1
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
TE
Test
Test · itcom7200
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
test202503100556
Test · hughhuh
Params7.62B
Context32K
Smallest8.1 GB
Tool use
TE
test
Test · Rout1ne
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test1
Test · BrunoGong
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test demo
Test · soladuor
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test traun
Test · indigo233
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · ozgurtas15
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
L3.1 RP TEST3
Test · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay

Keep browsing