GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gembo v1 70b
Gembo · Artefact2
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
SambaLingo Thai Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Bulgarian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
GE
em german 70b v01
German · jphme
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
SynthIA 7B v1.3 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SU
Superswallow 70b RP v0.3
Superswallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
LL
sanghwa na llama2 13b.kor.v2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GA
Gajendra v0.1
Gajendra · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Midnight Rose 70b v2.0.3
Midnight · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GI
Abacusai Giraffe 13b 32k v3
Giraffe · tensorblock
Params13B
Context32K
Smallest4.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Turkish Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
MY
MythoMakiseMerged 13b
Mythomakisemerged · Heralax
Params13B
Context4K
Smallest9.2 GB
GGUF
LL
birgermoell/Llama-3-dare_ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TH
Thespis 13B v0.5
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Uukuguy Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
KO
komodo 7b base
Komodo · QuantFactory
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
SN
SnowyRP FinalV1 L2 13B
Snowyrp · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
Roleplay
LE
13B Legerdemain L2
Legerdemain · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SU
Superswallow 7b v0.3
Superswallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 3 open hermes disco i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
NoFo codellama 13b v0.1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
VI
Vicuna 7b v1.5
Vicuna · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GI
Giraffe 13b 32k v3
Giraffe · RichardErkhov
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
SW
Swallow-70b-instruct-v0.1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
LL
frankencria llama2 12.5b v1.3 m.2
Llama · mradermacher
Params12.4B
Context4K
Q4_K_M7.5 GB
Coding
BA
Bailong instruct 7B
Bailong · NeroUCH
Params6.96B
Context4K
Smallest5.0 GB
GGUF
SY
SynthIQ 7b i1
Synthiq · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing