GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kimiko 7B
Kimi · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Radiantloom Llama 70b Instruct
Llama · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
SY
Synthia 13B
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
ReluLLaMA 7B PowerInfer
Relullama · Tiiny
Params7B
Context—
Smallest15.1 GB
GGUF
ME
models--AdaptLLM--medicine-chat
Medicine · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AU
Aurora Nights 103B v1.0 i1
Aurora · mradermacher
Params103B
Context4K
Smallest21.7 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Prosparse Llama 2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Openbuddy Codellama 70b v17.1
Llama · mradermacher
Params69.1B
Context16K
Q4_K_M41.5 GB
Coding
LL
mlfoundations dev llama2 oh teknium scaling down random 0.7
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Arabic Chat 70B
Sambalingo · RichardErkhov
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
ME
MetaMath 7B V1.0
Metamath · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
MetaMath 70B V1.0
Metamath · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 7B Instruct Fp16
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
LLama3 Gaja Hindi 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
persona generator llama 2 7b qlora merged
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
nnethercott llava v1.5 7b hf vicuna
LLaVA · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
CA
cat v1.0 13B
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
RoLlama2 7b Base 2024 05 14 i1
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 13B Ensemble v5
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KI
KitchenSink 103b
Kitchensink · mradermacher
Params103B
Context4K
Smallest38.2 GB
Roleplay
LL
Opencsg CodeLlama 7b v0.1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeciLM 6b
Decilm · mradermacher
Params5.72B
Context4K
Q4_K_M3.4 GB
GGUF
SA
SambaLingo Bulgarian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
TH
13B Thorns L2
Thorns · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KA
Kaori 70B v1
Kaori · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7b Ukrainian
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
frankencria llama2 11b v1.3 m.1 i1
Llama · mradermacher
Params9.98B
Context4K
Q4_K_M6.0 GB
Coding
CA
canarim 7B instruct
Canarim · lucianosb
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing