GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
MegaMix S1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XW
XwinCoder 34B i1
Xwincoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
VI
Vicuna 7b v1.5
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Thai Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
NO
Nova 13B 50 Step
Nova · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Class Tutor 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SambaLingo Turkish Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
NoFo codellama 34b v0.1 i1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Opencsg CodeLlama 34b v0.1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
mlfoundations dev llama2 oh teknium scaling down random 1.0
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
StableBeluga2 70B
Stablebeluga · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PS
13B-Psyfighter2-Erebus3-Slerp
Psyfighter · mradermacher
Params10.5B
Context4K
Q4_K_M6.3 GB
GGUF
AI
Airoboros L2 70b 2.2.1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.4
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
Airoboros C34B 2.2
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
SA
SambaLingo Slovenian Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
AU
Augmental ReMM 13b Merged
Augmental · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WE
Weyaxi OrcaMini Platypus2 13B QLoRA 0.80 epoch
Weyaxi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Lawyer Llama 13b v2
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
nsql llama 2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.5 GB
GGUF
LL
Openbuddy Codellama 70b v17.1
Llama · mradermacher
Params69.1B
Context16K
Q4_K_M41.5 GB
Coding
TA
RUCKBReasoning TableLLM 7b
Tablellm · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
CodingReasoning
LL
CodeActAgent Llama 2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LA
labradorite 13b
Labradorite · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13B Fp16
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama 2 7B 32K Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CoEvol ChatGPT_Llama2 7B_SFT
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
FA
Fairy2i W2
Fairy · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing