Vicuna GGUF models
158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.
VI
Vicuna 7b v1.5
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
st vicuna v1.3 5.5b ppl
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.5
Vicuna · shahzeb171
Params6.74B
Context4K
Smallest2.5 GB
VI
Vicuna 7b v1.5
Vicuna · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 7b Sharegpt Gpt4 48k
Vicuna · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
st vicuna v1.3 10.5b taylor
Vicuna · QuantFactory
Params10.5B
Context2K
Q4_K_M6.3 GB
VI
Vicuna Class Shishya 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna 13b v1.5
Vicuna · shahzeb171
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna 13b Cocktail
Vicuna · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
vicuna 13b self consistency random var 5 imatrix
Vicuna · liodon-ai
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vicuna 13b v1.5
Vicuna · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vicuna Backdoored 7B
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Luckychao Vicuna Backdoored 7B
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
vicuna-7b-v1.5-uncensored
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.5
Vicuna · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.3
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
VI
vicuna 13b self consistency random var 5
Vicuna · liodon-ai
Params13B
Context4K
Q4_K_M7.9 GB
VI
vicuna 7b v1.5 16k
Vicuna · shaowenchen
Params6.74B
Context16K
Smallest2.8 GB
VI
Vicuna 7b Wildchat Rephrase
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
yi6B_Vicuna
Vicuna · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
VI
Vicuna 7B Email DPO Hybrid
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 13b Free
Vicuna · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
VI
st vicuna v1.3 5.5b ppl
Vicuna · mradermacher
Params5.52B
Context2K
Q4_K_M3.3 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
st vicuna v1.3 5.5b taylor
Vicuna · mradermacher
Params5.52B
Context2K
Q4_K_M3.3 GB
VI
Vicuna Mmlu Val Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
st vicuna v1.3 5.5b taylor
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB