GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
LL
Wanda pruned Llama 2 7b 0.5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Samantha 1.11 CodeLlama 34b
Llama · mradermacher
Params33.7B
Context2K
Q4_K_M20.2 GB
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
CodeLlama 13b Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
BA
Bailong orpo 7B
Bailong · INX-TEXT
Params6.96B
Context4K
Smallest13.9 GB
LL
LLaMA Pro 8B Instruct
Llama · mradermacher
Params8.36B
Context4K
Q4_K_M5.1 GB
LL
Tamil Llama 13b Base v0.1
Llama · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
MI
speechless code mistral orca 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
CodeLlama 70b Instruct Hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
VE
Venus 120b v1.2
Venus · TheBloke
Params120B
Context4K
Smallest44.0 GB
OP
Openthaigpt 1.0.0 7b Chat
Openthaigpt · mradermacher
Params6.81B
Context4K
Q4_K_M4.1 GB
SA
SambaLingo Arabic Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
TE
Tess 70B v1.6
Tess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
PY
Pygmalion 2 13b iMatrix
Pygmalion · MarsupialAI
Params13B
Context4K
Smallest3.5 GB
SP
Spicyboros C34B 2.2
Spicyboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
SA
SambaLingo Slovenian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
LL
Llama 2 7b Verse Chat
Llama · ifaouibadi
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
EM German
German · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
SA
Samantha 1.1 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
VI
Vicuna Class Shishya 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
BI
BigLiz 120b i1
Bigliz · mradermacher
Params118B
Context4K
Smallest25.0 GB
ST
Storytime 13b
Storytime · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 13b Instruct Hf Abliterated
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LO
Vicuna 13b v1.5 16k
Logipt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
CIM LLaVA1.5 7B
LLaVA · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
PS
DaveGergern/13B-Psyfighter2-Erebus3-DareTies
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
DE
DetoxLLM 7B
Detoxllm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama2 13b Dpo v7
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
AI
Airoboros C34B 2.2.1
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB