GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
Thespis 13B v0.6
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Swap Uniba LLaMAntino 2 7b Hf ITA
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
WI
WizardMath 70B V1.0
Wizardmath · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · ysn-rfd
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
OP
Opencsg Stable Code 3b v1
Opencsg · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
OpenDolphinHermes Llama2 7B i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
LL
llama 3 merge disco neural pace i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SambaLingo Arabic Base 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
EL
elyza fork2
Elyza · mradermacher
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
XW
XwinCoder 13B
Xwincoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
ELYZA japanese Llama 2 13b fast
Llama · mmnga
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
SM
SMaxxxer v1 70b
Smaxxxer · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 7b Hf
Llama · divyanshusingh
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
Sambanovasystems SambaLingo Arabic Base
Sambalingo · tensorblock
Params6.95B
Context4K
Smallest2.7 GB
GGUF
ZI
Zihao Li mala 500 10b v2 merged
Zihao · RichardErkhov
Params8.61B
Context4K
Q4_K_M5.4 GB
GGUF
MI
Mimicra V1 13B
Mimicra · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
ReasoningRoleplay
SW
Swallow 70b RP
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
GG
gguf ssti
Gguf · Retr0REG
Params620M
Context32K
Smallest0.3 GB
Coding
MI
Speechless Thoughts Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Midnight Rose 103B v1.0
Midnight · Artefact2
Params103B
Context4K
Smallest27.3 GB
GGUF
IB
ibivibiv athene noctua 13b
Ibivibiv · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Model64
Model · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VI
vinallama 7b
Vinallama · LoneStriker
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
CO
CodeMate v0.1
Codemate · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
CH
ChocoLlama 2 7B Base
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
meditron 7b dpo full sft wo kqa silver wogold
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AD
ADELIE SFT 1.5B
Adelie · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · schroneko
Params13.1B
Context4K
Smallest8.0 GB
GGUF
LL
Llamas Community LlamaGuard 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · QuantFactory
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF

Keep browsing