GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7B Chat
Llama · second-state
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-Smaug-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 2 7b langchain chat
Llama · lucianosb
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
OpenMath CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
Coding
SA
sethuiyer_dr_samantha-7b
Samantha · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama2 70B SunsetBoulevard
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
OP
opus v0 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-fast
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Taiwan LLaMa v0.0
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GA
Gaja v1.00
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
nsql llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
FI
Finance Chat
Finance · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Story Reverse Prompt 70b Rope8 32K Fp16
Story · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WI
WinterGoliath 123b i1
Wintergoliath · mradermacher
Params124B
Context4K
Smallest26.3 GB
GGUF
DR
DrugAssist 7B
Drugassist · blazerye
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
Llemma_34B
Llemma · mradermacher
Params33.7B
Context4K
Q4_K_M20.2 GB
Reasoning
FI
finance chat
Finance · andrijdavid
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama2 70b chat uncensored
Llama · YokaiKoibito
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
llemma 7b
Llemma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
OP
Openthaigpt 1.0.0 7b Chat
Openthaigpt · mradermacher
Params6.81B
Context4K
Q4_K_M4.1 GB
GGUF
LL
swap uniba LLaMAntino 2 chat 13b hf ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
genz 13B v2
Genz · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vigogne 2 7B Chat
Vigogne · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Slovenian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
DO
Dolphin 2.1 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WH
WhiteRabbitNeo 13B
Whiterabbitneo · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SY
uukuguy_synthia-7b-v1.3-dare-0.85
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing