Vicuna GGUF models
158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.
VI
vicuna-13b-v1.5
Vicuna · cminja
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.8 GB
VI
Vicuna 7b v1.5
Vicuna · eccsm
Params6.74B
Context4K
Smallest4.2 GB
VI
Vicuna 7b v1.5
Vicuna · Medhaja
Params6.74B
Context4K
Smallest7.2 GB
VI
vicuna DocMental 1.1b v3
Vicuna · teka38
Params1.1B
Context2K
Smallest1.2 GB
VI
vicuna-13b-v1.5
Vicuna · justin-turner
Params13B
Context4K
Q4_K_M7.9 GB
VI
vicuna 13b v1.5
Vicuna · Tobius
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 13b v1.5
Vicuna · slightfx
Params135M
Context8K
Smallest0.3 GB
VI
Vicuna 13b v1.5
Vicuna · Jai-V
Params13B
Context4K
Smallest10.5 GB
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Smallest3.3 GB
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Smallest7.2 GB
VI
Vicuna 13b v1.5
Vicuna · pavitsu
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna Class Shishya All Hal 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
Vicuna 7b v1.3
Vicuna · nadeeem
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
vicuna 7b v1.3
Vicuna · AnkitS1997
Params6.74B
Context4K
Smallest7.2 GB
VI
vicuna 7b q8
Vicuna · eccsm
Params6.74B
Context4K
Smallest7.2 GB
VI
vicuna 13b v1.5
Vicuna · presencesw
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 13b v1.5
Vicuna · impro
Params4.97B
Context4K
Smallest5.3 GB
VI
vicuna 13b f16
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest26.0 GB
VI
vicuna 13b v1.5
Vicuna · sayliaware
Params6.74B
Context4K
Smallest7.2 GB
VI
vicuna 13b v1.5
Vicuna · Broxy
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 13b
Vicuna · dengdavidcheng
Params13B
Context4K
Smallest13.8 GB
VI
vicuna 13b v1.5
Vicuna · Catch25610
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 13b v1.5
Vicuna · gopinathankm
Params13B
Context4K
Smallest13.8 GB
VI
Vicuna 7b v1.3
Vicuna · Rajveercimcon
Params6.74B
Context2K
Smallest13.5 GB
VI
vicuna 7B v1.3 Q8 0
Vicuna · satyam-sundaram
Params162M
Context2K
Smallest0.2 GB
VI
Vicuna 13b v1.5
Vicuna · usutyono
Params13B
Context4K
Smallest13.8 GB
VI
vicuna compiled
Vicuna · akp-usr
Params6.74B
Context2K
Smallest4.1 GB
VI
vicuna 13b v1.5
Vicuna · M4tthias
Params13B
Context4K
Smallest13.8 GB