GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
CodeBooga 34B v0.1
Codebooga · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
Wanda pruned Llama 2 7b 0.3
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CA
Canarim 7b Vestibulaide
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Codellama CodeLlama 13b Python Hf
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
BI
BigWeave v6 90b
Bigweave · mradermacher
Params87.8B
Context4K
Smallest18.4 GB
GGUF
LL
Opencsg CodeLlama 34b v0.2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
AI
Airoboros L2 13b 3.0
Airoboros · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
WizardLM 1.0 Uncensored Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
FPHam/Sydney_Overthinker_13b_HF
Sydney · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
moneyforward houou instruction 7b v3
Moneyforward · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HA
Hamza Xl
Hamza · mradermacher
Params1.31B
Context1K
Q4_K_M0.9 GB
GGUF
TE
TeeZee Qra 13B chat
Teezee · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PS
Psyfighter2 13B Vore
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
InnerI InnerI AI sn6 7B slerp
Inneri · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
Goliath 120b
Goliath · mradermacher
Params118B
Context4K
Smallest24.7 GB
GGUF
DI
google/DiarizationLM-13b-Fisher-v1
Diarizationlm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SN
Snakmodel 7b Base
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Sinhala Translate And Dolly Llama 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Sheared LLaMA 2.7B
Llama · RichardErkhov
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
MI
Mistral Class Shishya All Hal 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SambaLingo Arabic Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TE
Tess XL v1.0 i1
Tess · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
CA
Doctor-Shotgun/CalliopeDS-v2-L2-13B
Calliopeds · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Opencsg CodeLlama 7b v0.1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DU
Duxiaoman DI XuanYuan 70B Chat
Duxiaoman · RichardErkhov
Params69.1B
Context8K
Q4_K_M41.5 GB
GGUF
SA
SambaLingo Hungarian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
TA
TableLLM 13b
Tablellm · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Reasoning
ST
stairolz 70b
Stairolz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing