GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 7B 2.2
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros L2 70B 2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
GGUF
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
LeetCodeWizard 13B v1.1a i1
Leetcodewizard · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
codellama_codellama-13b-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Speechless Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
LeetCodeWizard 7B V1.1 i1
Leetcodewizard · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
codellama_codellama-7b-python-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
phind_phind-codellama-34b-python-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
CodeLlama 70B Python
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
CH
Chronos Hermes 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
LL
ehartford_wizardlm-1.0-uncensored-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
AI
airoboros l2 c70b 3.1.2 i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
JA
japanese stablelm instruct beta 7B
Japanese · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
jondurbin_airoboros-c34b-3.1.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
GE
Genz 70b
Genz · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
LLaMA2 13B Tiefighter i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
DI
discoresearch_discolm-70b
Discolm · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
Tool use
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
GGUF
AI
Airochronos L2 13B
Airochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ShiningValiantXS 1.1
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing