GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
SynthIA 70B v1.5 i1
Synthia · mradermacher
Params69B
Context2K
Smallest15.9 GB
GGUF
LL
wei123602 llama2 13b fintune2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GE
Gembo v1.1 70b
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 Ko 7b
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
VI
Vinallama 7b Chat
Vinallama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
LL
Llama 2 7b Hf
Llama · yashagra
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
JE
jebcarter Psyfighter 13B
Jebcarter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
aipixel tag creator 7b
Aipixel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
leolm 70b chat Q5 K M
Leo · miweru
Params69B
Context8K
Smallest48.8 GB
GGUF
BA
Barcenas 7b
Barcenas · Danielbrdz
Params6.74B
Context4K
Smallest4.7 GB
GGUF
AT
Athena 120b
Athena · bcse
Params120B
Context4K
Smallest44.2 GB
GGUF
WI
Winged Lagomorph 2x13B
Winged · mradermacher
Params21.5B
Context16K
Q4_K_M13.0 GB
GGUF
LL
meta Llama 2 7b
Llama · easynet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Speechlessai Speechless Codellama Dolphin Orca Platypus 13b
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
MI
152334H_miqu 1 70b Sf
Miqu · NexesQuants
Params69B
Context32K
Smallest47.9 GB
GGUF
LL
CodeLlama 34b
Llama · Userb1az
Params33.7B
Context16K
Smallest35.9 GB
Coding
DI
Dicephal 123B i1
Dicephal · mradermacher
Params124B
Context4K
Smallest26.3 GB
GGUF
BI
BigWeave v6 90b
Bigweave · mradermacher
Params87.8B
Context4K
Smallest32.3 GB
GGUF
LL
H2Ogpt 4096 Llama2 70b
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
Meditron 7b
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
H2Ogpt 4096 Llama2 7b Chat
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Phind Phind CodeLlama 34B Python v1
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
llama 2 13b chat platypus
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
CO
CodeRosa 70B AB1 XXL
Coderosa · altomek
Params69B
Context16K
Smallest31.8 GB
Coding
LL
Daekeun Ml Llama 2 Ko DPO 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Meta Llama CodeLlama 34b Hf
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
prosparse llama 2 13b
Llama · Tiiny
Params13B
Context—
Smallest27.6 GB
CodingEmbedding
LL
cria-llama2-7b-v1.3.ggmlv3.q4_0.bin
Llama · davzoku
Params6.74B
Context2K
Smallest3.8 GB
Coding
LL
telugu llama 7b instruct v0.1
Llama · abhinand
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Dolphin Llama2 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing