GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CO
CodeBooga 34B v0.1
Codebooga · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Wanda pruned Llama 2 7b 0.3
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CA
Canarim 7b Vestibulaide
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Codellama CodeLlama 13b Python Hf
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
BI
BigWeave v6 90b
Bigweave · mradermacher
Params87.8B
Context4K
Smallest18.4 GB
LL
Opencsg CodeLlama 34b v0.2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
AI
Airoboros L2 13b 3.0
Airoboros · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
WizardLM 1.0 Uncensored Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SY
FPHam/Sydney_Overthinker_13b_HF
Sydney · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
MO
moneyforward houou instruction 7b v3
Moneyforward · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
HA
Hamza Xl
Hamza · mradermacher
Params1.31B
Context1K
Q4_K_M0.9 GB
TE
TeeZee Qra 13B chat
Teezee · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PS
Psyfighter2 13B Vore
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
IN
InnerI InnerI AI sn6 7B slerp
Inneri · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GO
Goliath 120b
Goliath · mradermacher
Params118B
Context4K
Smallest24.7 GB
DI
google/DiarizationLM-13b-Fisher-v1
Diarizationlm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
SN
Snakmodel 7b Base
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Sinhala Translate And Dolly Llama 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Sheared LLaMA 2.7B
Llama · RichardErkhov
Params2.7B
Context4K
Q4_K_M1.6 GB
MI
Mistral Class Shishya All Hal 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SambaLingo Arabic Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
TE
Tess XL v1.0 i1
Tess · mradermacher
Params118B
Context4K
Smallest25.0 GB
CA
Doctor-Shotgun/CalliopeDS-v2-L2-13B
Calliopeds · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
Opencsg CodeLlama 7b v0.1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DU
Duxiaoman DI XuanYuan 70B Chat
Duxiaoman · RichardErkhov
Params69.1B
Context8K
Q4_K_M41.5 GB
SA
SambaLingo Hungarian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
TA
TableLLM 13b
Tablellm · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
ST
stairolz 70b
Stairolz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB