GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Wanda pruned Llama 2 7b 0.5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Samantha 1.11 CodeLlama 34b
Llama · mradermacher
Params33.7B
Context2K
Q4_K_M20.2 GB
Coding
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
CodeLlama 13b Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
BA
Bailong orpo 7B
Bailong · INX-TEXT
Params6.96B
Context4K
Smallest13.9 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · mradermacher
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
LL
Tamil Llama 13b Base v0.1
Llama · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
MI
speechless code mistral orca 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
CodeLlama 70b Instruct Hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
VE
Venus 120b v1.2
Venus · TheBloke
Params120B
Context4K
Smallest44.0 GB
GGUF
OP
Openthaigpt 1.0.0 7b Chat
Openthaigpt · mradermacher
Params6.81B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Arabic Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
TE
Tess 70B v1.6
Tess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 13b iMatrix
Pygmalion · MarsupialAI
Params13B
Context4K
Smallest3.5 GB
GGUF
SP
Spicyboros C34B 2.2
Spicyboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
SA
SambaLingo Slovenian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 7b Verse Chat
Llama · ifaouibadi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
EM German
German · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
Samantha 1.1 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VI
Vicuna Class Shishya 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
BI
BigLiz 120b i1
Bigliz · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
ST
Storytime 13b
Storytime · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13b Instruct Hf Abliterated
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LO
Vicuna 13b v1.5 16k
Logipt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Reasoning
LL
CIM LLaVA1.5 7B
LLaVA · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
PS
DaveGergern/13B-Psyfighter2-Erebus3-DareTies
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
DetoxLLM 7B
Detoxllm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama2 13b Dpo v7
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
AI
Airoboros C34B 2.2.1
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF

Keep browsing