GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 Ko Instruct 13B
Llama · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
LlamaGuard 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
CodeBarcenas-7b.Q4_K_M
Codebarcenas · Danielbrdz
Params6.74B
Context2K
Q4_K_M4.2 GB
GGUF
LL
Llava v1.5 13B
LLaVA · 404-OS
Params13B
Context4K
Smallest7.4 GB
Vision
LL
Llava 1.5 7b Hf
LLaVA · colossatr0n
Params6.74B
Context4K
Smallest7.2 GB
Vision
VI
Vicuna Class Shishya Ac Hal 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MO
MoMo 70B V1.0
Momo · tensorblock
Params69B
Context4K
Smallest25.5 GB
GGUF
GI
Giraffe v2 13b 32k
Giraffe · claysauruswrecks
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Secbone llama 2 13B instructed
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
vinallama 2.7b chat
Vinallama · vilm
Params2.77B
Context4K
Smallest1.9 GB
GGUF
PH
PJ Phayao Final NA JA
Phayao · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
CH
Changgil k2s3 test 24001
Changgil · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b chat hf system design test fine tuned cpu
Llama · lltutor
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo-Hungarian-Chat
Sambalingo · zsolx2
Params6.95B
Context4K
Smallest4.0 GB
GGUF
VI
Vicuna 7b v1.5 16k
Vicuna · Kondara
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · ar08
Params6.74B
Context4K
Smallest3.1 GB
GGUF
JA
JailJudge Guard
Jailjudge · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
llama 2 13b vacancies
Llama · AlekseyScorpi
Params13B
Context4K
Q4_K_M7.9 GB
Coding
LL
Llama 2 7b Chat Hf
Llama · Spockkk
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PY
Pygmalion 2 13b
Pygmalion · Lucy-in-the-Sky
Params13B
Context4K
Smallest13.8 GB
GGUF
CH
chronob 70b
Chronob · uncensorie
Params69B
Context4K
Smallest39.1 GB
GGUF
OP
Openbuddy Llemma 34b v13.1
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
GGUF
KO
komodo7b sunda lemess
Komodo · SutanRifkyt
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · menuthaw98
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LL
Bangla Llama 2 7b base v0.1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
wilson
Wilson · wilson989
Params6.74B
Context32K
Smallest4.1 GB
GGUF
VI
vicuna 7b v1.5
Vicuna · Shreyas0706
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
MoP_llama_2_40_percent_compression_2_epochs
Llama · c2d-usp
Params3.86B
Context4K
Q4_K_M3.4 GB
GGUF
LL
Llama 2 7b Hf
Llama · jx11235
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · divyanshusingh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing