GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MY
Mythalion 13b
Mythalion · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
TA
Tai
Tai · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 70b Hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros L2 7b 2.1
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7b Hf
Llama · alphaduriendur
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
sambanovasystems.SambaLingo Hungarian Chat
Sambalingo · DevQuasar
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Russian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SP
Uukuguy Speechless Coding 7b 16k Tora
Speechless · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
ME
Medicine Chat
Medicine · hellork
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
Phind CodeLlama 34B v1
Llama · Nondzu
Params33.7B
Context—
Smallest19.1 GB
GGUF
AD
ADELIE DPO 3B
Adelie · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
DaringFortitude
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gembo v1 70b
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
touhouai instruct llama 2 7b
Llama · huohong123
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LA
AdaptLLM Law Chat
Law · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
XU
XuanYuan 6B
Xuanyuan · mradermacher
Params6.39B
Context8K
Q4_K_M3.9 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · alphaduriendur
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
dect phone Llama 2 7b Finale
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SU
Superswallow 70b RP v0.3
Superswallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
LL
Llama 2 7B
Llama · SergeUSS
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AL
ALMA 7B Ja V2
Alma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
nb sau 13b 4k step100k
Llama · NbAiLab
Params13B
Context4K
Smallest26.0 GB
GGUF
MI
Caisarl76 Mistral 7B OpenOrca Guanaco Accu16
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
et2 experimental
Llama · halflucifer
Params134M
Context1K
Smallest0.0 GB
GGUF
LL
CodeLlama 7b hf rust finetune
Llama · alphahg
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
XO
XOrcaSlimWin 13B
Xorcaslimwin · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
posicube Llama chat AY 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SU
Superswallow 70b NVE
Superswallow · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
SA
l2 7b sayori ddlc v0.1
Sayori · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing