GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Swallow 13b NVE Hf
Swallow · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
ME
Meditron 7b
Meditron · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
Vicuna Class Shishya All Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Pkupie Lawyer Llama 13b v2
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
LL
swap uniba LLaMAntino 2 chat 7b hf ITA
Llama · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
llama 2 13b chat
Llama · SandLogicTechnologies
Params13B
Context4K
Q4_K_M7.9 GB
Reasoning
KI
KitchenSink 103b
Kitchensink · bcse
Params103B
Context4K
Smallest37.9 GB
Roleplay
FI
13B FINAL CHATBOT
Final · PisutDeekub
Params13.1B
Context4K
Smallest26.2 GB
GGUF
AI
Airoboros L2 13b 3.0
Airoboros · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · stellali0115
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
heilbronnpodcasts
German · TristanBehrens
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
japanese llama 2 7b
Llama · owner203
Params6.97B
Context4K
Smallest4.0 GB
GGUF
SH
Shoppal Shoppal v0.1
Shoppal · tensorblock
Params69B
Context4K
Smallest25.5 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · Kondara
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · dpant
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Nous Hermes 2 Llama 2 70B iMat
Llama · NexesQuants
Params69B
Context4K
Smallest14.5 GB
Tool use
LL
unicode llama 2 chat Hf q4
Llama · Ranjanunicode
Params6.74B
Context4K
Smallest4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 2 7b Hf
Llama · seungwon12
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
vicuna 7b v1.5
Vicuna · TheMarmot
Params6.74B
Context4K
Smallest27.0 GB
GGUF
AL
altomek CodeRosa 70B AB1
Altomek · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
RE
SparseLLM Reglu 15B
Reglu · tensorblock
Params1.33B
Context2K
Smallest0.5 GB
GGUF
MI
Mistral 7b v5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
CodeLlama 7b Instruct hf
Llama · kirstus
Params6.74B
Context16K
Smallest7.2 GB
Coding
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · jmainformatique
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · atahmih
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
Llama 2 7b chat hf network test fine tuned cpu
Llama · lltutor
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PR
Premerge XE XE 123B
Premerge · mradermacher
Params124B
Context4K
Smallest45.7 GB
GGUF
KA
kaori 70b v1 i1
Kaori · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing