GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
Openbuddy Llemma 34b v13.2
Openbuddy · tensorblock
Params33.8B
Context4K
Smallest12.6 GB
GGUF
ST
Stheno-Inverted-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · avikam
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
haryra 7b llama2 id i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RO
RoLlama2-7b-Base
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LL
Sheared LLaMA 2.7B Pruned
Llama · tensorblock
Params2.7B
Context4K
Smallest1.0 GB
GGUF
YU
l2 7b yuri ddlc v0.1
Yuri · 922-CA
Params6.74B
Context2K
Smallest5.1 GB
GGUF
MI
Midnight Rose 103b v1.0
Midnight · mradermacher
Params103B
Context4K
Smallest37.9 GB
GGUF
LL
CodeLlama 7b Hf
Llama · HARRY07979
Params6.74B
Context16K
Smallest3.8 GB
Coding
PE
perky 70b v0.1
Perky · Dracones
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · bkoerner
Params13B
Context16K
Smallest9.2 GB
Coding
AD
Keg Party 3B Q8 0
Adelie · IntelligentEstate
Params3.61B
Context128K
Smallest3.8 GB
GGUF
LL
Zyh3826 20231206094523 Pretrain Llama 2 13b Hf 76000
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
NE
NexusRaven 13B
Nexusraven · tensorblock
Params13B
Context16K
Smallest4.9 GB
GGUF
ST
stairolzlv 70b i1
Stairolzlv · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WA
Walmart the bag MysticFusion 13B
Walmart · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HI
HindiModel
Hindimodel · AshishK
Params6.87B
Context4K
Smallest3.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · irresistiblegrace97
Params6.74B
Context4K
Smallest7.6 GB
GGUF
QW
medical advisor qlora
Qwen · kaushik2202
Params87M
Context—
Smallest0.3 GB
GGUF
AL
ALMA 7B Ja V2
Alma · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Uukuguy Speechless Mistral Dolphin Orca Platypus Samantha 7b Dare 0.85
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TA
Tai i1
Tai · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
gaodrew llama 2 7b roman empire qa 27k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama-2-7b-Ukrainian
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
TS
tsukasa 120b qlora
Tsukasa · bcse
Params118B
Context4K
Smallest43.2 GB
GGUF
KA
kaori 70b v1
Kaori · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 7b
Pygmalion · JK1116
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openbuddy llemma 34b v13.1
Openbuddy · sprint-mammoth
Params33.8B
Context4K
Q4_K_M20.3 GB
GGUF
DO
Dolphin 2.2 70b
Dolphin · Iambackup
Params69B
Context4K
Smallest48.8 GB
GGUF
LL
Aqweteddy Llama2 7b Capybara
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF

Keep browsing