Experiment GGUF models

393 GGUF models in the Experiment family, quantized by 20 uploaders. Sizes run from 3.09B to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
EX
experiment3 Q4 K M
Experiment · qa-02
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
EX
experiment Q4 K M.gguf
Experiment · Nithin-2812
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
EX
Experiment v2 Q6 K
Experiment · cgato
Params12.2B
Context128K
Smallest10.1 GB
GGUF

Keep browsing