GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
LL
TheBloke/CodeLlama-13B-Python-fp16
Llama · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
XW
Xwin LM 70B V0.1 Limarpv3 i1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
AU
Augmental 13b v1.50 A
Augmental · Heralax
Params13B
Context4K
Smallest9.2 GB
LL
CodeLlama CoinMath 7B
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.5
Vicuna · shahzeb171
Params6.74B
Context4K
Smallest2.5 GB
LL
H2Ogpt 32k Codellama 34b Instruct
Llama · RichardErkhov
Params33.7B
Context32K
Q4_K_M20.2 GB
SA
samba 1.1B
Samba · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
AR
Arcane 13b
Arcane · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AI
Airoboros L2 7b 2.2.1
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
medicine chat
Medicine · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Watashiha Llama 2 13B Ogiri Sft
Llama · RichardErkhov
Params13.1B
Context4K
Q4_K_M8.0 GB
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
SA
SambaLingo Slovenian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
AI
airoboros l2 70b 2.1 creative i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Codellama 7b Hf SFT Warmup GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
AI
Airoboros L2 13b 2.2
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AU
Augmental ReMM 13b Merged
Augmental · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PY
Pygmalion 2 13b SuperCOT
Pygmalion · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
SA
SambaLingo Thai Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
LL
Llama 2 13b Lemon Alpaca
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 70b Instruct hf
Llama · Artefact2
Params69B
Context4K
Q4_K_M41.4 GB
SN
Snakmodel 7b Instruct
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
martyn llama2 megamerge dare 13b v1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
abacusai/Llama-3-Smaug-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BI
BigWeave v7.1 124b
Bigweave · mradermacher
Params124B
Context4K
Smallest26.0 GB
LL
Llama 2 7b Chat Hf Heretic
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
Medicine Chat
Medicine · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
H2Ogpt 16k Codellama 34b Instruct
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
BA
Bailong Orpo 7B
Bailong · mradermacher
Params6.96B
Context4K
Q4_K_M4.2 GB
HO
Honyaku-13b
Honyaku · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB