Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
Test2 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Test Q4 K M
Test · Atzemo
Params4.63B
Context128K
Q4_K_M3.4 GB
Vision
TE
Test 7B
Test · raincandy-u
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
test
Test · Etherll
Params303M
Context2K
Q4_K_M0.2 GB
GGUF
TE
test split model stories260K
Test · angt
Params—
Context2K
Smallest0.0 GB
GGUF
TE
Weyaxi/test-help-steer-filtered-orig
Test · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Test
Test · AbelWa
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
TE
Danilas/test3
Test · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
Test0 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
test model
Test · SAi404
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
MS3 test Merge 1
Test · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
TE
4.5test
Test · mradermacher
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
TE
test quen 2.5 lora merged
Test · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
TE
test 15102026 1
Test · theetee012345
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
TE
Test 12B v1b
Test · BeaverAI
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TE
test model
Test · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TE
test marketting v2
Test · wan-su
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TE
999G/test
Test · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TE
k2s3 test 0000
Test · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
TE
Rama-adi/test-merge
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TE
test gguf 1
Test · zjsfxpm1
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
TE
test nemo
Test · kholiavko
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
TE
test anciety model q3 q4 f16
Test · robloxianer
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
TE
test model
Test · pengqun
Params596M
Context40K
Smallest0.3 GB
ReasoningTool use
TE
test gguf 1mkv
Test · angt
Params—
Context—
Smallest0.0 GB
GGUF
TE
L3 8x3B RP Test
Test · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
RoleplayTool use
TE
Test_Finetune_Llm
Test · iambestfeed
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TE
my test model8
Test · AX1Y2JP
Params11.9B
Context—
Smallest12.7 GB
GGUF
TE
Test2_3
Test · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
k2s3 test 0002
Test · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing