GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llava 1.5 13b Hf
LLaVA · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Vision
LL
LLama3 Gaja Hindi 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Airoboros L2 7b 3.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Codellama Megamerge Dare 34b
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
lgaalves llama 2 13b chat platypus
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SC
SchweinZwei 13b
Schweinzwei · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GI
abacusai/Giraffe-13b-32k-v3
Giraffe · featherless-ai-quants
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
LL
Opencsg CodeLlama 13b v0.1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
GraveSocialAI
Gravesocialai · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SambaLingo Russian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Dolphin Llama2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
CodeMate v0.1
Codemate · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
kodonho llama2 chat koalpaca
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RO
RoLlama2 7b Base 2024 05 14
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TA
Tat Llm 13b Fft
Tat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ZI
Zihao Li mala 500 10b v1 merged
Zihao · RichardErkhov
Params8.61B
Context4K
Q4_K_M5.4 GB
GGUF
AI
airoboros l2 70b 2.1 creative
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SP
Spicyboros 13b 2.2
Spicyboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 34b hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
YO
Youri 7b
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HI
KaraKaraWitch/HiTZ-GoLLIE-13B-AsSafeTensors
Hitz · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CodingReasoning
LL
Opencsg CodeLlama 34b v0.2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
SP
Spicyboros 7b 2.2
Spicyboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 70b Instruct Hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
CodeLlama 70b Python hf
Llama · LoneStriker
Params69B
Context2K
Q4_K_M41.4 GB
Coding
AI
Airoboros C34B 2.2
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF

Keep browsing