GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LO
LongAlpaca 70B
Longalpaca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
meditron 70B
Meditron · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llava v1.5 7B
LLaVA · second-state
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
XW
Xwin LM 70B V0.1
Xwin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SP
uukuguy_speechless-tora-code-7b-v1.0
Speechless · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HE
conceptofmind_hermes-llongma-2-13b-8k
Hermes · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
Tool use
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
WI
WizardMath 7B V1.0
Wizardmath · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LA
law chat
Law · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
FR
Free Sydney V2 13B
Free · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EV
EverythingLM 13b V2 16K
Everythinglm · TheBloke
Params13B
Context—
Q4_K_M6.3 GB
GGUF
LL
Dolphin Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-7b-plus-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
PY
Pygmalion 2 13B SuperCOT
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13B MORepair
Llama · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
Coding
TO
tokyotech llm Swallow 7b instruct v0.1
Tokyotech · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
GGUF
ME
MegaDolphin 120b i1
Megadolphin · mradermacher
Params120B
Context4K
Smallest25.6 GB
GGUF
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Emma 500 Llama2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
llm-agents_tora-code-7b-v1.0
Tora · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing