GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
KA
KaeriJenti Kaori 34B v1
Kaori · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · usutyono
Params13B
Context4K
Smallest13.8 GB
GGUF
KA
Kaori 34b v3
Kaori · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
EV
EvolCodeLlama 7b Q8 0
Evolcodellama · ani-kavle
Params6.74B
Context16K
Smallest7.2 GB
Coding
AI
airoboros 33b 3.1.2 q4 k m
Airoboros · jondurbin
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
VI
Vinallama 7b IQ1 M
Vinallama · TrinhChou1102
Params6.86B
Context4K
Smallest13.7 GB
GGUF
AI
airoboros l2 c70b 3.1.2 q4 k m
Airoboros · jondurbin
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
RE
ReluLLaMA-7B
Relullama · qweasd9827
Params6.74B
Context2K
Smallest7.2 GB
GGUF
LL
tariq llama2
Llama · zah12ra
Params6.74B
Context4K
Smallest4.1 GB
GGUF
AR
ArtificialSentience
Artificialsentience · siwiak
Params13B
Context4K
Smallest13.8 GB
GGUF
GO
gollie 13b v0.1
Gollie · myclassunil
Params13B
Context16K
Smallest13.8 GB
GGUF
MY
X MythoChronos 13B
Mythochronos · afpro
Params13B
Context4K
Smallest7.4 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · AnkitS1997
Params13B
Context4K
Smallest13.8 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · rakesh2222
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
Llama 2 7b spin 10k
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BO
Bosbeyin
Bosbeyin · Bosbeyin
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 7B chemical
Vicuna · Rebecca19990101
Params6.74B
Context2K
Smallest7.2 GB
GGUF
LE
LeoLM leo hessianai 70b
Leolm · RichardErkhov
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
BH
BhabhaAI Gajendra v0.1
Bhabhaai · RichardErkhov
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
EP
epfl llm meditron 7b Q4 K M
Epfl · bsampath
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TR
traclm v2 7b instruct
Traclm · TRAC-MTRY
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SE
SeELLama
Seellama · DehydratedWater42
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 q4
Llama · ttom525tw
Params6.74B
Context2K
Smallest4.1 GB
GGUF
LL
llama 2 7b 143k codeAlpaca q4 K M 2025 10 29 1424
Llama · vampirelibrarianmonk
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing