Test GGUF models

486 GGUF models in the Test family, quantized by 342 uploaders. Sizes run from 1M to 284B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
test model router download
Test · ggml-org
Params1M
Context2K
Smallest0.0 GB
GGUF
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
GGUF
TE
test model stories260K
Test · ggml-org
Params—
Context—
Smallest0.0 GB
GGUF
TE
test model stories260K infill
Test · ggml-org
Params—
Context—
Smallest0.0 GB
GGUF
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GGUF
TE
test gguf moe sample
Test · SzymonOzog
Params403M
Context—
Smallest0.1 GB
GGUF
TE
test gguf models
Test · ngxson
Params2B
Context32K
Q4_K_M1.2 GB
GGUF
TE
Test
Test · Aname-Tommy
Params4.21B
Context256K
Smallest2.6 GB
ReasoningTool use
TE
Test1_SLIDE
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
4.5test
Test · mradermacher
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
TE
TEST2 Q2.5 Lenned 14B
Test · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
TE
Test_FIBO_IDEN_FFN
Test · ysn-rfd
Params6.87B
Context32K
Smallest4.9 GB
GGUF
TE
L3 8x3B RP Test i1
Test · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
RoleplayTool use
TE
TEST2 Q2.5 Lenned 14B i1
Test · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
TE
Test
Test · ConicCat
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
TE
test
Test · zuv0
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
TE
TEST2 Q2.5 Lenned 14B
Test · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
TE
Test 22B
Test · RichardErkhov
Params21.8B
Context2K
Q4_K_M13.2 GB
GGUF
TE
test
Test · zenlkq
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TE
chenluuli/test-text-vis
Test · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
TE
test
Test · bedobedo
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
TE
Byungchae/k2s3_test_0001
Test · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
test gguf lora adapter
Test · ngxson
Params1M
Context64
Smallest0.0 GB
GGUF
TE
Byungchae/k2s3_test_0002
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TE
test model
Test · RTannous
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TE
alnrg2arg/test_wanda_240109
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TE
test gguf modified
Test · rarad
Params620M
Context32K
Smallest0.3 GB
GGUF
TE
test model 1b
Test · SAi404
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TE
iustinnn/test-model
Test · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
TEST3 Q2.5 Lenned 14B
Test · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use

About the Test GGUF models

Test is represented on ggufmodels.com by 486 GGUF models, quantized by 342 uploaders on Hugging Face. The most downloaded are test model router download, test gguf sample and test model stories260K. Parameter counts run from 1M to 284B, and the longest trained context window is 1024K tokens.

A Q4_K_M file of a Test model is between 0.0 to 72.9 GB, which is the quant most people start with. Most files come from tensorblock (14), featherless-ai-quants (10) and shidowake (9). The quants you will meet most often are Q8_0 (188), Q4_K_M (186), F16 (77) and Q5_K_M (74), where the number is how many models offer that quant.

Frequently asked questions

Which Test GGUF should I download?

The most downloaded Test GGUF here is test model router download. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Test model need?

Q4_K_M files of Test models on this site range from 0.0 to 72.9 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Test GGUF files come from?

The most common quantizers here are tensorblock, featherless-ai-quants and shidowake. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing