Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
test again
Test · dishanR
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
TEST DRUG TRIAL
Test · TAT2025
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · XOLODILNIK
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
test toasted bunny twins Q8 0
Test · Karko
Params12.9B
Context4K
Smallest13.7 GB
GGUF
TE
TEST OcerusBeam 7B Q5 K M
Test · djuna
Params7.24B
Context512K
Smallest5.1 GB
GGUF
TE
Test_Eye_2
Test · l202147
Params7.24B
Context32K
Smallest7.7 GB
GGUF
TE
test slo 3
Test · Eram83
Params3.21B
Context128K
Smallest2.3 GB
Tool use
TE
test fine tuning
Test · chiling1024
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
TE
test model
Test · random971
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · mazingj5
Params3.09B
Context32K
Smallest3.3 GB
GGUF
TE
test
Test · yaoqi826
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · sanGe003
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
TE
Test156
Test · Sela223
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
test llm local
Test · bearhuang
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test
Test · maplesnow
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test master unit test model f16
Test · metindeder
Params7.62B
Context32K
Smallest15.2 GB
GGUF
TE
test
Test · Jee
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
TEST REPO
Test · artzuros
Params7.24B
Context32K
Smallest5.0 GB
GGUF
TE
Test_Fine_Tuning
Test · Tales-Alves
Params8.03B
Context8K
Smallest8.5 GB
GGUF
TE
test
Test · Kevin-Rain
Params8.54B
Context8K
Smallest9.1 GB
GGUF
TE
test llm
Test · Liu-SHI
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test model cf
Test · avk20
Params1.24B
Context128K
Smallest2.5 GB
Tool use
TE
test
Test · ydgqq07
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test 1
Test · noe95
Params8.03B
Context4K
Q4_K_M8.1 GB
Tool use
TE
test 240110 revised swallow 7B hf qlora adaptor merged
Test · shidowake
Params6.83B
Context4K
Smallest4.9 GB
GGUF
TE
test 240206 cyber2base 7B qlora adaptor pretrained merged 16bit
Test · shidowake
Params7.01B
Context4K
Smallest7.5 GB
GGUF
TE
test
Test · invalid-coder
Params11B
Context4K
Smallest0.0 GB
Coding
TE
test5
Test · rasaboun
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
test
Test · BeaverAI
Params34.4B
Context32K
Smallest20.7 GB
GGUF
TE
Test 1.1b
Test · Novaciano
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing