GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 13B Python Fp16
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
WI
WizardLM 13B V1.2
Wizardlm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
LL
OpenMath CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Samantha 1.11 CodeLlama 34b
Llama · mradermacher
Params33.7B
Context2K
Q4_K_M20.2 GB
Coding
SA
SambaLingo Hungarian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SA
Samantha 1.11 7b i1
Samantha · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
Xwin LM 70B V0.1 i1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama-2-7b-chat-hf
Llama · Mungert
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AG
agentlm 70B
Agentlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OP
Opencsg Stable Code 3b v1
Opencsg · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Prosparse Llama 2 13b
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 70B LoRA Assemble v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
SambaLingo Arabic Base 70B
Sambalingo · RichardErkhov
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Llama 2 7b Chat Hf Heretic
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RO
Rogue Rose 103b v0.2
Rogue · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
RO
Rogue Rose 103b v0.2 i1
Rogue · mradermacher
Params103B
Context4K
Smallest22.0 GB
GGUF
SA
SambaLingo Japanese Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama2 70B SunsetBoulevard
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
KI
Kimiko 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama2 7B layla
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SN
Snakmodel 7b Base
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
leolm_leo-hessianai-13b
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b chat norwegian
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AL
AlpacaCielo 13B
Alpacacielo · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
conceptofmind_hermes-llongma-2-7b-8k
Hermes · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
Tool use
XW
Xwin LM 13B V0.1
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KA
kaori 34b v4 i1
Kaori · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing