GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CodingReasoning
AI
airoboros l2 13B 3.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-instruct
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
firefly llama2 7B chat
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
LO
Vicuna 13b v1.5 16k
Logipt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Reasoning
HI
HiTZ GoLLIE 13B AsSafeTensors i1
Hitz · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
IN
InverseCoder-CL-7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
XW
Xwin LM 13B V0.2
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
OpenMath-CodeLlama-7b-Python-hf
Llama · Mungert
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openthaigpt 1.0.0 13b Chat
Openthaigpt · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SP
Spicyboros 7B 2.2
Spicyboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-70b-NVE-instruct-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HU
Huginn 22B Prototype
Huginn · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
TH
Thespis 13B v0.4
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FI
13B FINAL CHATBOT
Final · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama 2 7b langchain chat
Llama · YanaS
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BI
BigAurelian v0.5 120b 32k i1
Bigaurelian · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
SP
Spicyboros 70B 2.2
Spicyboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ES
EstopianMaid 13B i1
Estopianmaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
ON
Oni-7B-slerp
Oni · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
lmsys_vicuna-7b-v1.5-16k
Vicuna · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 34b Python hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AT
athena 120b i1
Athena · mradermacher
Params120B
Context4K
Smallest26.1 GB
GGUF
LL
88_Llama2_32k_Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LE
13B Legerdemain L2
Legerdemain · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
Samantha 1.1 70b i1
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
NoFo codellama 13b v0.1 i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding

Keep browsing