GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
CodeLlama 7b Instruct Hf
Llama · m2hgamerz
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
ELYZA japanese Llama 2 MoE 2x7B v0.1
Llama · mradermacher
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
LL
Llama2 13B Eugeneparkthebest
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama 2 7b chat hf
Llama · alokabhishek
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
ELYZA japanese Llama 2 MoE 2x13B v0.1
Llama · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
TI
Haary/TinyLlama-1.1B-indo-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SU
Superswallow 13b v0.1
Superswallow · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
RO
Rogue Rose 103b v0.2
Rogue · mradermacher
Params103B
Context4K
Smallest38.2 GB
GGUF
LL
Llama 2 7b EAX
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 7b chat tagalog v0.3a
Llama · 922-Narra
Params6.74B
Context2K
Smallest4.2 GB
GGUF
LL
CodeLlama-13b-hf
Llama · UniOb
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SU
Superswallow 70b v0.3
Superswallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
LA
Law Chat
Law · hellork
Params6.74B
Context4K
Smallest3.8 GB
GGUF
SP
Uukuguy Speechless Tools 7b
Speechless · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Tool use
LL
H2Ogpt 4096 Llama2 13b
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LlamaGuard 7b
Llama · wenqiglantz
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LI
Lima Unchained 70b
Lima · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
Code Llama 2 13B instruct text2sql
Llama · support-pvelocity
Params13B
Context16K
Q4_K_M7.9 GB
Coding
CO
controllable-wizardlm-7b
Controllable · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HA
Hamza Xl
Hamza · mradermacher
Params1.31B
Context1K
Q4_K_M0.9 GB
GGUF
LL
LLaMA2 13B TiefighterLR i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
sanghwa-na/llama2-13b.kor.v1
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
prosparse llama 2 7b
Llama · SparseLLM
Params7B
Context—
Smallest14.5 GB
CodingEmbedding
LL
CodeLlama 7b Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
GE
em german 13b v01
German · jphme
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Code Llama 2 7B instruct text2sql
Llama · support-pvelocity
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
openbuddy codellama2 34b v11.1
Llama · LeeEric
Params33.8B
Context16K
Q4_K_M20.3 GB
Coding
GR
GraveSocialAI
Gravesocialai · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SP
spicyboros 70b 2.2 i1
Spicyboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF

Keep browsing