GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
Huginn 13B v4.5
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
Medinote 7b
Medinote · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7b Instruct Solidity
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SP
Spring Dragon
Spring · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EV
EverythingLM 13b 16k
Everythinglm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · MaziyarPanahi
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Lawyer Llama 13b v2
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
LLaMA 2 7B 32K
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
AU
Aurora Nights 70B v1.0
Aurora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
GGUF
AE
aegolius acadicus v1 30b
Aegolius · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
LL
Colossal LLaMA 2 13b Base
Llama · mradermacher
Params13.4B
Context4K
Q4_K_M8.1 GB
GGUF
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros L2 7b 3.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
conceptofmind_llongma-2-7b
Llongma · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
EV
totally-not-an-llm_everythinglm-13b-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
CO
CodeV-CL-7B
Codev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LA
latxa-70b-v1.2
Latxa · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
LLaMA 2 7B 32K Instruct
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
CodeActAgent Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
AR
ArcaneEntanglement model64 70b
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OP
openchat v3.2 super
Openchat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
ChatAYT Lora Assamble Marcoroni
Chatayt · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Aurora Nights 103B v1.0
Aurora · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
PU
PuddleJumper 13b
Puddlejumper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA japanese CodeLlama 7b
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Airoboros L2 70b 2.2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing