GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
prosparse llama 2 13b
Llama · SparseLLM
Params13B
Context—
Smallest27.6 GB
CodingEmbedding
CH
chimera 120b
Chimera · mradermacher
Params120B
Context4K
Smallest45.0 GB
GGUF
LL
KoboldAI LLaMA2 13B Tiefighter
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
VN
vntl 7b v0.3.1
Vntl · lmg-anon
Params6.74B
Context4K
Smallest7.2 GB
GGUF
FI
Finance Chat
Finance · hellork
Params6.74B
Context4K
Smallest3.8 GB
GGUF
OP
openchat openchat v3.2 super
Openchat · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LM
LMCocktail 10.7B v1 Function Calling
Lmcocktail · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
DO
DoubleGold v0.5 123b 32k
Doublegold · mradermacher
Params124B
Context32K
Smallest45.7 GB
GGUF
TA
RUCKBReasoning TableLLM 13b
Tablellm · tensorblock
Params13B
Context16K
Smallest4.9 GB
CodingReasoning
AI
Airoboros L2 13b 2.2
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
Megamix A1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EU
Euryale 1.3 L2 70B i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
H2Oai H2Ogpt 32k Codellama 34b Instruct
Llama · tensorblock
Params33.7B
Context32K
Smallest12.5 GB
Coding
LL
CodeLlama 34b Hf
Llama · straino
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Martyn Llama2 Megamerge Dare 13b v2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Tamil Llama 7b Base v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
GGUF
LL
CodeLlama 70b Instruct iMat
Llama · dranger003
Params69B
Context4K
Smallest14.5 GB
Coding
SA
l2 7b sayori ddlc v0.1 i1
Sayori · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
WI
WizardLM-70B-V1.0
Wizardlm · LiteLLMs
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros L2 70b 2.1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llemma_34B
Llemma · mradermacher
Params33.7B
Context4K
Q4_K_M20.2 GB
Reasoning
YA
Yakult 70B i1
Yakult · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
bunnycore/Blackbird-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QR
OPI-PG/Qra-13b
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Midnight Rose 103B v1.0
Midnight · LoneStriker
Params103B
Context4K
Smallest37.9 GB
GGUF
VI
vigogne 2 13b chat
Vigogne · cmh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Taiwan LLaMa v0.0
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
dragon llama 7b v0
Llama · llmware
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing