Vicuna GGUF models

158 GGUF models in the Vicuna family, quantized by 70 uploaders. Sizes run from 68M to 32.5B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
VI
vicuna-13b-v1.5
Vicuna · cminja
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · eccsm
Params6.74B
Context4K
Smallest4.2 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Medhaja
Params6.74B
Context4K
Smallest7.2 GB
GGUF
VI
vicuna DocMental 1.1b v3
Vicuna · teka38
Params1.1B
Context2K
Smallest1.2 GB
GGUF
VI
vicuna-13b-v1.5
Vicuna · justin-turner
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · Tobius
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · slightfx
Params135M
Context8K
Smallest0.3 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · Jai-V
Params13B
Context4K
Smallest10.5 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Smallest3.3 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · atultomar
Params6.74B
Context2K
Smallest7.2 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · pavitsu
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna Class Shishya All Hal 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · nadeeem
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
vicuna 7b v1.3
Vicuna · AnkitS1997
Params6.74B
Context4K
Smallest7.2 GB
GGUF
VI
vicuna 7b q8
Vicuna · eccsm
Params6.74B
Context4K
Smallest7.2 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · presencesw
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · impro
Params4.97B
Context4K
Smallest5.3 GB
GGUF
VI
vicuna 13b f16
Vicuna · umerfiazsubnet
Params13B
Context4K
Smallest26.0 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · sayliaware
Params6.74B
Context4K
Smallest7.2 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · Broxy
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 13b
Vicuna · dengdavidcheng
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · Catch25610
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · gopinathankm
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · Rajveercimcon
Params6.74B
Context2K
Smallest13.5 GB
GGUF
VI
vicuna 7B v1.3 Q8 0
Vicuna · satyam-sundaram
Params162M
Context2K
Smallest0.2 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · usutyono
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
vicuna compiled
Vicuna · akp-usr
Params6.74B
Context2K
Smallest4.1 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · M4tthias
Params13B
Context4K
Smallest13.8 GB
GGUF

Keep browsing