Vicuna GGUF models

158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
VI
Vicuna 7b v1.5
Vicuna · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna Class Shishya Ac Hal 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
Vicuna 7b v1.5 16k
Vicuna · Kondara
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b v1.5 16k
Vicuna · hbacard
Params13B
Context16K
Smallest13.8 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · substratusai
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 7b v1.5
Vicuna · Shreyas0706
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · ProfessorH
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · RajShah-1
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · yargpt
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
vicuna 13b v1.5 16k
Vicuna · Eric111
Params13B
Context4K
Smallest26.0 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · rpp01
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b local
Vicuna · dengdavidcheng
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · LeyaGao
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · prastya
Params6.74B
Context2K
Smallest7.2 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · Vigneshwaran-D
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7B v1.5
Vicuna · SinpxAI
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · POWERHACK
Params6.74B
Context4K
Smallest4.7 GB
GGUF
VI
vicuna 0.5b v1.5
Vicuna · teka38
Params464M
Context32K
Smallest0.5 GB
GGUF
VI
gguf sharded vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Smallest0.2 GB
GGUF
VI
gguf vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
VI
Vicuna 7b v1.5 16k
Vicuna · PiterOfc
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · YoSHiK
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Smallest7.2 GB
GGUF
VI
Vicuna 7B v1.3
Vicuna · SinpxAI
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.3 GB
GGUF
VI
vicuna q8
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 13b v1.5 gguf test
Vicuna · Sabih555
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · ksajan
Params6.74B
Context2K
Smallest7.2 GB
GGUF

Keep browsing