Vicuna GGUF models
158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.
VI
Vicuna 7b v1.1
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
Lorinma yi6B_Vicuna
Vicuna · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna 13b v1.5
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna Mmlu Val Only Correct Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
vicuna class student all hal 7b
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
st vicuna v1.3 10.5b ppl
Vicuna · QuantFactory
Params10.5B
Context2K
Q4_K_M6.3 GB
VI
vicuna 33b v1.3
Vicuna · sirovub
Params32.5B
Context2K
Smallest34.6 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
vicuna 33b v1.3
Vicuna · Nexesenex
Params32.5B
Context2K
Q4_K_M19.6 GB
VI
gguf vicuna 68m
Vicuna · Felladrin
Params68M
Context2K
Q4_K_M0.0 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
st vicuna v1.3 10.5b ppl
Vicuna · mradermacher
Params10.5B
Context2K
Q4_K_M6.3 GB
VI
Vicuna 13B v1.3
Vicuna · gotzmann
Params13B
Context4K
Smallest7.4 GB
VI
st vicuna v1.3 10.5b taylor
Vicuna · mradermacher
Params10.5B
Context2K
Q4_K_M6.3 GB
VI
Vicuna 14 05 25
Vicuna · Asit03
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vicuna Class Shishya All Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
FelixChao vicuna 7B chemical
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
VI
Vicuna 13b v1.5
Vicuna · Kondara
Params13B
Context4K
Q4_K_M7.9 GB
VI
vicuna 7b v1.5
Vicuna · TheMarmot
Params6.74B
Context4K
Smallest27.0 GB
VI
Vicuna
Vicuna · tleo
Params8.03B
Context8K
Smallest4.9 GB
VI
Vicuna 7b v1.3
Vicuna · crohan009
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
TheBloke Vicuna 33B 1 3 SuperHOT 8K Fp16
Vicuna · tensorblock
Params32.5B
Context8K
Smallest12.0 GB
VI
Vicuna Class Shishya Ac Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
VI
Vicuna Class Tutor 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
vicuna 13b v1.5
Vicuna · heyi-88
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.5
Vicuna · Sri-Vigneshwar-DJ
Params6.74B
Context4K
Smallest13.5 GB
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Q4_K_M4.1 GB