GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ShiningValiantXS i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
GGUF
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b WikiChat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
TU
Tulpar 7B v0
Tulpar · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
uukuguy_speechless-mistral-dolphin-orca-platypus-samantha-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 7B
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
AI
jondurbin_airoboros-c34b-2.2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
JA
japanese stablelm base beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-fast-instruct
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
WI
WizardCoder Python 13B V1.0
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QR
Qra 13B chat i1
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
Rose 20B
Rose · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
CO
oobabooga_codebooga-34b-v0.1
Codebooga · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
SA
SauerkrautLM 13B v1
Sauerkrautlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TR
Trurl 2 7B
Trurl · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
llm-agents_tora-code-34b-v1.0
Tora · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llama2 7b chat codeCherryPop qLoRA
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 13B
Swallow · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
VI
vicuna 7B v1.5
Vicuna · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
leolm_leo-hessianai-7b-chat
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
CH
Chronomaid Storytelling 13B
Chronomaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing