GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
Labradorite 13b
Labradorite · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Aurora Nights 70b v1.0
Aurora · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Serbian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeciLM 6b Instruct
Decilm · mradermacher
Params5.72B
Context4K
Q4_K_M3.4 GB
GGUF
ME
Meditron 70b
Meditron · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
migtissera_synthia-34b-v1.2
Migtissera · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
openbuddy llama2 70B v13.2
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
AI
airoboros l2 7B 3.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QR
Qra 13b i1
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Opencsg CodeLlama 13b v0.1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
LLaMA 2 7B 32K
Llama · QuantFactory
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
AI
Airoboros L2 13b 2.2.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
UN
Uni TianYan 70B
Uni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7B LoRA Assemble
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Midnight Rose 103B v2.0.3 i1
Midnight · mradermacher
Params103B
Context4K
Smallest22.0 GB
GGUF
LL
Radiantloom Llama 70b Instruct
Llama · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SA
SambaLingo Thai Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
CH
Chronoboros Grad L2 13B
Chronoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
Openthaigpt 1.0.0 70b Chat
Openthaigpt · mradermacher
Params69.1B
Context2K
Q4_K_M41.5 GB
GGUF
LL
Llama2 13B ShiningValiant i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
SynthIA 70B v1.5
Synthia · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
MI
Misal 7B Base v0.1
Misal · mradermacher
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
LL
posicube Llama2 chat AYB 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YO
Youri 7b
Youri · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BA
Bailong Orpo 7B
Bailong · mradermacher
Params6.96B
Context4K
Q4_K_M4.2 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.3
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 13b Python Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
ME
Medinote 7b
Medinote · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing