Vicuna GGUF models
158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.
VI
Vicuna 7b v1.5
Vicuna · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna Class Shishya Ac Hal 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
Vicuna 7b v1.5 16k
Vicuna · Kondara
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
vicuna 13b v1.5 16k
Vicuna · hbacard
Params13B
Context16K
Smallest13.8 GB
VI
vicuna 13b v1.5
Vicuna · substratusai
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 7b v1.5
Vicuna · Shreyas0706
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 13b v1.5
Vicuna · ProfessorH
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.5
Vicuna · RajShah-1
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
vicuna 13b v1.5
Vicuna · yargpt
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.5
Vicuna · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
VI
vicuna 13b v1.5 16k
Vicuna · Eric111
Params13B
Context4K
Smallest26.0 GB
VI
Vicuna 7b v1.5
Vicuna · rpp01
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
vicuna 13b local
Vicuna · dengdavidcheng
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.5
Vicuna · LeyaGao
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
vicuna 13b v1.5
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.3
Vicuna · prastya
Params6.74B
Context2K
Smallest7.2 GB
VI
vicuna 13b v1.5
Vicuna · Vigneshwaran-D
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7B v1.5
Vicuna · SinpxAI
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.5
Vicuna · POWERHACK
Params6.74B
Context4K
Smallest4.7 GB
VI
vicuna 0.5b v1.5
Vicuna · teka38
Params464M
Context32K
Smallest0.5 GB
VI
gguf sharded vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Smallest0.2 GB
VI
gguf vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
VI
Vicuna 7b v1.5 16k
Vicuna · PiterOfc
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
vicuna 13b v1.5
Vicuna · YoSHiK
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Smallest7.2 GB
VI
Vicuna 7B v1.3
Vicuna · SinpxAI
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.3 GB
VI
vicuna q8
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 13b v1.5 gguf test
Vicuna · Sabih555
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.3
Vicuna · ksajan
Params6.74B
Context2K
Smallest7.2 GB