Vicuna GGUF models
158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.
VI
vicuna 13b v1.5
Vicuna · sayuaware
Params6.74B
Context4K
Smallest7.2 GB
VI
vicuna 13b v1.5
Vicuna · anujvaghani0
Params6.74B
Context4K
Smallest7.2 GB
VI
Vicuna 13b v1.5
Vicuna · AnkitS1997
Params13B
Context4K
Smallest13.8 GB
VI
vicuna-7b-v1.3
Vicuna · shuaiye
Params6.74B
Context2K
Smallest3.8 GB
VI
vicuna-7b-v1.3
Vicuna · shuaiye
Params6.74B
Context2K
Smallest13.5 GB
VI
Vicuna 13b v1.5
Vicuna · rakesh2222
Params13B
Context4K
Smallest13.8 GB
VI
vicuna DocMental 0.5b v2.2
Vicuna · teka38
Params464M
Context32K
Smallest0.9 GB
VI
vicuna 7B chemical
Vicuna · Rebecca19990101
Params6.74B
Context2K
Smallest7.2 GB