GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
TheBloke/CodeLlama-13B-Python-fp16
Llama · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
Coding
XW
Xwin LM 70B V0.1 Limarpv3 i1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
AU
Augmental 13b v1.50 A
Augmental · Heralax
Params13B
Context4K
Smallest9.2 GB
GGUF
LL
CodeLlama CoinMath 7B
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
VI
Vicuna 7b v1.5
Vicuna · shahzeb171
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
H2Ogpt 32k Codellama 34b Instruct
Llama · RichardErkhov
Params33.7B
Context32K
Q4_K_M20.2 GB
Coding
SA
samba 1.1B
Samba · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
AR
Arcane 13b
Arcane · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 7b 2.2.1
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
medicine chat
Medicine · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Watashiha Llama 2 13B Ogiri Sft
Llama · RichardErkhov
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SA
SambaLingo Slovenian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
AI
airoboros l2 70b 2.1 creative i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Codellama 7b Hf SFT Warmup GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AI
Airoboros L2 13b 2.2
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Augmental ReMM 13b Merged
Augmental · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
Pygmalion 2 13b SuperCOT
Pygmalion · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Thai Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Llama 2 13b Lemon Alpaca
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 70b Instruct hf
Llama · Artefact2
Params69B
Context4K
Q4_K_M41.4 GB
Coding
SN
Snakmodel 7b Instruct
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
martyn llama2 megamerge dare 13b v1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
abacusai/Llama-3-Smaug-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
BigWeave v7.1 124b
Bigweave · mradermacher
Params124B
Context4K
Smallest26.0 GB
GGUF
LL
Llama 2 7b Chat Hf Heretic
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
Medicine Chat
Medicine · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
H2Ogpt 16k Codellama 34b Instruct
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
BA
Bailong Orpo 7B
Bailong · mradermacher
Params6.96B
Context4K
Q4_K_M4.2 GB
GGUF
HO
Honyaku-13b
Honyaku · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing