Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
Test Model
Test · Techrex
Params163M
Context1K
Smallest0.3 GB
GGUF
TE
test model
Test · IJUN
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test model preset
Test · ngxson
Params81M
Context125K
Q4_K_M0.1 GB
Tool use
TE
test1 Q4 K M
Test · nicolollo
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
test
Test · Takobisa
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
TEST Magidonia 24B v4.3 creative ORPO v5
Test · WarlordHermes
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
TE
Test Fine Tuning
Test · zakie0161
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
test eqat q3.6 27b 1
Test · sdkyuan
Params26.9B
Context256K
Smallest8.6 GB
ReasoningTool use
TE
mergekit linear lyapgfy Q5 K M
Test · djuna
Params8.03B
Context128K
Smallest5.7 GB
GGUF
TE
test
Test · mammothsoft
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test 240202 cyber2 chat
Test · shidowake
Params7.01B
Context32K
Smallest7.5 GB
GGUF
TE
test gguf 2
Test · zjsfxpm1
Params7.62B
Context128K
Smallest3.0 GB
Tool use
TE
test train on responses gguf 3b 2 epochs
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
test 240111 defalut template swallow 7B hf qlora adaptor 4bit merged
Test · shidowake
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
TE
test upload
Test · Harsha-ALTEN
Params7.24B
Context32K
Smallest5.1 GB
GGUF
TE
test
Test · JatinkInnovision
Params7.25B
Context32K
Smallest7.7 GB
Tool useVision
TE
ai test math
Test · jbugguys
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TE
test
Test · xzyuse
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
Test01
Test · squallml
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test
Test · SaiHarshitha17
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
TE
test
Test · Ainonake
Params8.03B
Context8K
Smallest4.9 GB
GGUF
TE
test model
Test · kiwoju
Params3.21B
Context128K
Smallest3.4 GB
GGUF
TE
test
Test · saharat-robo
Params163M
Context1K
Smallest0.2 GB
GGUF
TE
test model
Test · OmerHofFJ
Params8.03B
Context128K
Smallest2.9 GB
Tool use
TE
Mn 12b Test Ft
Test · SuperbEmphasis
Params11.2B
Context128K
Smallest9.2 GB
GGUF
TE
test2
Test · lilithmk3
Params4.21B
Context32K
Smallest2.0 GB
ReasoningTool use
TE
Test0614
Test · rain0111
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test-large-data-model-gguf
Test · rmsdud
Params8.03B
Context8K
Smallest8.5 GB
GGUF
TE
test3 Q4 K M
Test · aianurag
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
TE
Test I Am
Test · AndreiWTP
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF

Keep browsing