GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
Sourajeetsahoo119 Meditron 7b Finetuned
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
Vision
UN
h0l0 3.4.2 13b uncen
Uncen · Cr0n3
Params13B
Context4K
Smallest4.9 GB
GGUF
SP
Henk717 spring dragon
Spring · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llava 1.5 7b Hf
LLaVA · Marwan02
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
OR
orthorus 125b moe
Orthorus · mradermacher
Params125B
Context2K
Smallest46.7 GB
GGUF
LL
codellama_codellama-13b-instruct-hf
Llama · DevShubham
Params13B
Context16K
Smallest13.8 GB
Coding
LL
Meta Llama Llama 2 13b Chat Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · tsqn
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llava v1.5 13b dpo
LLaVA · antiven0m
Params13B
Context4K
Q4_K_M7.9 GB
Vision
MI
Midnight Rose 70b v1.0
Midnight · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · Georgia47
Params6.74B
Context4K
Q4_K_M8.2 GB
GGUF
ST
Stheno-Inverted-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
Winged Lagomorph 2x13B i1
Winged · mradermacher
Params21.5B
Context16K
Q4_K_M13.0 GB
GGUF
ME
MegaMix-S1-13B
Megamix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PS
Psydestroyer 20B
Psydestroyer · seb-c
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MA
MaximalSlerp
Maximalslerp · Brouz
Params13B
Context4K
Smallest9.2 GB
GGUF
TI
Tiefighter L2 13B
Tiefighter · AI-Engine
Params13B
Context4K
Smallest5.4 GB
GGUF
LL
llama2 13b.kor.v1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
CO
Yang Z CodeV CL 7B
Codev · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
MO
MoMo 70B V1.2 1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
EV
Totally Not An Llm EverythingLM 13b 16k
Everythinglm · tensorblock
Params13B
Context16K
Smallest4.9 GB
GGUF
LL
Phind CodeLlama 34B v2
Llama · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
Coding
YA
jan-hq/Yakult-70B
Yakult · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
CodeLlama 7b Hf
Llama · harishforaiandml
Params6.74B
Context16K
Smallest2.5 GB
Coding
LL
Llama 2 7B Chat
Llama · vicky4s4s
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
Featherless Chat Models Llama2 13b Chat Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Tamil llama2 v1
Llama · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo-Slovenian-Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing