Vicuna GGUF models

158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
VI
Vicuna 7b v1.1
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Lorinma yi6B_Vicuna
Vicuna · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna Mmlu Val Only Correct Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
vicuna class student all hal 7b
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
st vicuna v1.3 10.5b ppl
Vicuna · QuantFactory
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
VI
vicuna 33b v1.3
Vicuna · sirovub
Params32.5B
Context2K
Smallest34.6 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
vicuna 33b v1.3
Vicuna · Nexesenex
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
VI
gguf vicuna 68m
Vicuna · Felladrin
Params68M
Context2K
Q4_K_M0.0 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
st vicuna v1.3 10.5b ppl
Vicuna · mradermacher
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
VI
Vicuna 13B v1.3
Vicuna · gotzmann
Params13B
Context4K
Smallest7.4 GB
GGUF
VI
st vicuna v1.3 10.5b taylor
Vicuna · mradermacher
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
VI
Vicuna 14 05 25
Vicuna · Asit03
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna Class Shishya All Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
FelixChao vicuna 7B chemical
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · Kondara
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
vicuna 7b v1.5
Vicuna · TheMarmot
Params6.74B
Context4K
Smallest27.0 GB
GGUF
VI
Vicuna
Vicuna · tleo
Params8.03B
Context8K
Smallest4.9 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · crohan009
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
TheBloke Vicuna 33B 1 3 SuperHOT 8K Fp16
Vicuna · tensorblock
Params32.5B
Context8K
Smallest12.0 GB
GGUF
VI
Vicuna Class Shishya Ac Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna Class Tutor 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · heyi-88
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Sri-Vigneshwar-DJ
Params6.74B
Context4K
Smallest13.5 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing