GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ShiningValiantXS
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
GGUF
MI
uukuguy_collectivecognition-v1.1-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 34b Instruct hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Codellama 2 7b Miniguanaco Mistral
Llama · Nexesenex
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Vijendra CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SA
saiga2 7b
Saiga · IlyaGusev
Params6.74B
Context4K
Smallest2.8 GB
GGUF
CO
Copus 2x8B
Copus · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
AI
Airoboros C34B 2.2.1
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
GE
em german 7b v01
German · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Stheno v2 Delta
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
SY
Synthia 13B v1.2
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeActAgent Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
CodeLlama 34b Python Hf
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
LLaMAntino 2 Chat 13b Hf UltraChat ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airavata
Airavata · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.1
Llama · RichardErkhov
Params7B
Context4K
Q4_K_M4.1 GB
GGUF
GR
GREEN RadLlama2 7b i1
Green · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TA
TableLLM-13b
Tablellm · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
CodingReasoning
LL
Sheep Duck Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
frankencria llama2 12.5b v1.3 m.2 i1
Llama · mradermacher
Params12.4B
Context4K
Q4_K_M7.5 GB
Coding
WI
WizardLM 70B V1.0
Wizardlm · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llemma_7B
Llemma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
IB
ibivibiv aegolius acadicus v1 30b
Ibivibiv · RichardErkhov
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
MI
Midnight Rose 70B v2.0.3
Midnight · Artefact2
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
LLaMAntino 2 Chat 7b Hf UltraChat ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CA
canarim 7B
Canarim · lucianosb
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
Xwin Math 13B V1.0
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing