GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Guard 7B
Llama · andrijdavid
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Grafted Llama2 2x70B
Llama · mradermacher
Params125B
Context4K
Smallest45.9 GB
GGUF
LL
llama 2 20 percent compression Q4 K M
Llama · PruningEverything
Params5.4B
Context4K
Q4_K_M4.8 GB
GGUF
WI
WinterGoliath 123b 32k
Wintergoliath · mradermacher
Params124B
Context32K
Smallest45.7 GB
GGUF
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Smallest7.2 GB
GGUF
LL
llama2 med summarizer
Llama · imkalpx
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Hf
Llama · Cheatmeal
Params6.74B
Context4K
Smallest3.8 GB
GGUF
XW
Xwin LM 70B V0.1_Jannie
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
Meditron 7b
Meditron · Axcel1
Params6.74B
Context2K
Smallest5.5 GB
GGUF
LL
llama2 med summarizer
Llama · ritujaa1
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama2 7b customer service
Llama · pranav301102
Params6.74B
Context2K
Smallest7.2 GB
GGUF
ME
MegaMix-T1-13B
Megamix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VE
Venus-103b-v1.2
Venus · mradermacher
Params103B
Context4K
Smallest37.9 GB
GGUF
RI
risks 7b
Risks · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RE
ReluLLaMA 7B Q4 0
Relullama · tt144
Params6.74B
Context2K
Smallest3.8 GB
GGUF
WI
WizardCoder Python 34B V1.0
Wizardcoder · tsqn
Params33.7B
Context16K
Smallest19.1 GB
Coding
LL
Llama 2 7b Chat Hf
Llama · Fabio2000
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-2-7b-chat-hf
Llama · zhentaoyu
Params6.74B
Context4K
Smallest3.8 GB
GGUF
AI
Airoboros C34B 3.1.2
Airoboros · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
GGUF
VE
Venus 103b v1.1
Venus · mradermacher
Params103B
Context4K
Smallest37.9 GB
GGUF
LL
LLaMA2-13B-Erebus-v3
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · msyu1020
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · yashagra
Params6.74B
Context4K
Smallest3.8 GB
GGUF
DO
Vihangd Dopeyshearedplats 1.3b v1
Dopeyshearedplats · tensorblock
Params1.35B
Context4K
Smallest0.6 GB
GGUF
LL
CodeLlama 7b Hf
Llama · alphaduriendur
Params6.74B
Context16K
Smallest3.8 GB
Coding
MI
Mimicra V1 13B
Mimicra · Masterjp123
Params13B
Context4K
Smallest7.4 GB
ReasoningRoleplay
ED
edu hub
Edu · Aswanth1611
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · xiangshun-zhao
Params6.74B
Context4K
Smallest3.8 GB
GGUF
AH
ahnyeonchan OpenOrca AYT 13B
Ahnyeonchan · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing