GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
InstructWise 462M
Instructwise · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
LL
WizardLM 1.0 Uncensored CodeLlama 34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SA
Dr Samantha 7b i1
Samantha · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama2 chat AYB 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
MetaMath 13B V1.0
Metamath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
RuterNorway Llama 2 13b chat norwegian
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Turkish Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Tamil Llama 7b Instruct v0.1
Llama · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
CO
CodeV CL 7B
Codev · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
minima 3b layla v2
Minima · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
CH
chronob 1.4 lin 70b i1
Chronob · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 13B V0.1 i1
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
maximuslee07/llama-2-13b-rockwellautomation
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13b chat norwegian i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DY
DynamicFactor
Dynamicfactor · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
airoboros l2 13b 3.1.1 i1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
Medicine Chat
Medicine · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Midnight Rose 70b v1.0
Midnight · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 13B V0.2
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 70b Python Hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
GA
Gaja v2.00
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
IC
ICE GRT i1
Ice · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
YU
Yuren 13b Chatml
Yuren · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.6
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
WizardCoder Python 7B V1.0
Wizardcoder · lainlives
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing