LLaVA GGUF models

77 GGUF models in the LLaVA family, quantized by 44 uploaders. Sizes run from 374M to 34.4B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
nanoLLaVA-1.5
LLaVA · bee-kake
Params620M
Context32K
Smallest1.2 GB
Vision
LL
llava
LLaVA · cortexso
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
LL
LLaVA Med weights2
LLaVA · sbottazzi
Params6.74B
Context2K
Smallest7.2 GB
Vision
LL
ggml llava v1.5 13b
LLaVA · benjamincham
Params13B
Context4K
Smallest7.9 GB
Vision
LL
TinyLLaVA iOS clip base patch32
LLaVA · MasakiK
Params1.1B
Context2K
Smallest0.7 GB
Vision
LL
TinyLLaVA iOS clip base patch16
LLaVA · MasakiK
Params1.1B
Context2K
Smallest0.7 GB
Vision
LL
nanoLLaVA-1.5
LLaVA · saiphyohein
Params620M
Context32K
Smallest0.4 GB
Vision
LL
TinyLLaVA iOS clip large patch14
LLaVA · MasakiK
Params1.1B
Context2K
Smallest0.7 GB
Vision
LL
llava test
LLaVA · ha1772007
Params3.82B
Context4K
Smallest1.4 GB
Vision
LL
Lucian 32b Merged
LLaVA · ArellaVale
Params32.8B
Context40K
Smallest34.8 GB
ReasoningTool useVision
LL
TinyLLaVA iOS clip large patch14 336
LLaVA · MasakiK
Params1.1B
Context2K
Smallest0.7 GB
Vision
LL
LLaVA
LLaVA · HyperMink
Params6.74B
Context4K
Smallest4.1 GB
Vision
LL
test llava will be deleted soon
LLaVA · ngxson
Params7.06B
Context4K
Smallest14.1 GB
Vision
LL
smartvisit llava
LLaVA · angellovelyyadav
Params6.74B
Context4K
Smallest4.8 GB
Vision
LL
Llava
LLaVA · Inza124
Params6.74B
Context4K
Smallest4.1 GB
Vision
LL
lucian 32b q4
LLaVA · ArellaVale
Params32.8B
Context40K
Smallest19.8 GB
ReasoningTool useVision
LL
bakllava 14b 2xMoE alpha build
LLaVA · nisten
Params12.9B
Context32K
Smallest0.6 GB
Vision

Keep browsing