GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Class Shishya 7b Ep3
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
OpenDolphinHermes Llama2 7B
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Tool use
LL
llama 2 13b pubmed qa 211k gguf q8 0
Llama · BLACKBUN
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
llama2 7b sft full llama2
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VN
vntl 13b v0.2
Vntl · lmg-anon
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA Japanese Llama 2 13b Fast
Llama · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · PiterOfc
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 34b Uncode
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
CO
CodeBooga 34B v0.1
Codebooga · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
GGUF
XW
Xwin LM 70B V0.1
Xwin · firelzrd
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 13B V0.1
Xwin · firelzrd
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ChibiAsmAi Z80 7b
Llama · chibiakumas-com
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MO
monika ddlc 13b v1
Monika · 922-CA
Params13B
Context4K
Smallest9.2 GB
GGUF
KA
Kakkokari 13b
Kakkokari · Heralax
Params13B
Context4K
Smallest7.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Uukuguy CollectiveCognition v1.1 Mistral 7B Dare 0.85
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
HE
Hermes Synthia 7B
Hermes · Lazycuber
Params6.74B
Context4K
Smallest7.2 GB
Tool use
JA
japanese alpaca 2 13b
Japanese · owner203
Params13.3B
Context2K
Smallest7.6 GB
GGUF
LL
lawyer-llama-13b-v2
Llama · xiaoshuai111
Params13.3B
Context4K
Smallest7.6 GB
GGUF
GS
gsm8k farhan fullFT
Gsm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XU
Xuanyuan_6B
Xuanyuan · tensorblock
Params6.39B
Context8K
Smallest2.4 GB
GGUF
PR
protectai models Retr0REG Whats up
Protectai · retroboy3000
Params620M
Context32K
Smallest0.3 GB
Coding
LL
Llama 2 123b
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · wilson989
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
code millenials 34b
Code · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 2 13b chat hf
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · Fabio2000
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Tamil Llama 13b Instruct v0.1
Llama · tensorblock
Params13.2B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · nil471
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llamandement 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF

Keep browsing