Vicuna GGUF models

158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
VI
Vicuna 7b v1.5
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
st vicuna v1.3 5.5b ppl
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · shahzeb171
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b Sharegpt Gpt4 48k
Vicuna · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
st vicuna v1.3 10.5b taylor
Vicuna · QuantFactory
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
VI
Vicuna Class Shishya 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · shahzeb171
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna 13b Cocktail
Vicuna · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b self consistency random var 5 imatrix
Vicuna · liodon-ai
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna Backdoored 7B
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Luckychao Vicuna Backdoored 7B
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
vicuna-7b-v1.5-uncensored
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
VI
vicuna 13b self consistency random var 5
Vicuna · liodon-ai
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
vicuna 7b v1.5 16k
Vicuna · shaowenchen
Params6.74B
Context16K
Smallest2.8 GB
GGUF
VI
Vicuna 7b Wildchat Rephrase
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
yi6B_Vicuna
Vicuna · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
VI
Vicuna 7B Email DPO Hybrid
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 13b Free
Vicuna · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
VI
st vicuna v1.3 5.5b ppl
Vicuna · mradermacher
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
st vicuna v1.3 5.5b taylor
Vicuna · mradermacher
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
VI
Vicuna Mmlu Val Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
st vicuna v1.3 5.5b taylor
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing