Experiment GGUF models
393 GGUF models in the Experiment family, quantized by 20 uploaders. Sizes run from 3.09B to 70.6B parameters. The longest trained context is 256K tokens.
EX
experiment3 Q4 K M
Experiment · qa-02
Params7.62B
Context32K
Q4_K_M4.7 GB
EX
experiment Q4 K M.gguf
Experiment · Nithin-2812
Params3.21B
Context128K
Q4_K_M2.0 GB
EX
Experiment v2 Q6 K
Experiment · cgato
Params12.2B
Context128K
Smallest10.1 GB