GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
spack llama 7b
Llama · daniellnichols
Params6.74B
Context16K
Smallest3.8 GB
Coding
LL
ELYZA Japanese Llama 2 13b Fast Instruct
Llama · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 2 13b Hf
Llama · shoh99
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · ysn-rfd
Params6.74B
Context16K
Smallest2.5 GB
Coding
AU
Aurora Nights 70B v1.0 GGUF 2bit
Aurora · Artefact2
Params69B
Context4K
Smallest18.3 GB
GGUF
LL
meditron-7b
Llama · ccarrez
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SE
SeewebLLM it Q2 K
Seewebllm · antoste
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Uukuguy Mistral 7b Platypus Fp16 Dare 0.9
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ME
Megamix-A1-13B
Megamix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LM
Yhyu13/LMCocktail-10.7B-v1-function-calling
Lmcocktail · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
LL
CodeLlama 13B TestGen Dart v0.2
Llama · jacobhoffmann
Params13B
Context16K
Smallest7.4 GB
Coding
RE
REMM PYG 0.65 SLERP
Remm · Brouz
Params13B
Context4K
Smallest9.2 GB
GGUF
AU
Augmental 13b two epochs
Augmental · Heralax
Params13B
Context4K
Smallest9.2 GB
GGUF
LL
Llama-2-13b-chat-hf
Llama · zhentaoyu
Params13B
Context4K
Smallest7.4 GB
GGUF
EC
SnowyRP FinalV1 L2 13B
Echidna · Masterjp123
Params13B
Context4K
Smallest7.4 GB
Roleplay
PE
perky 103b v0.1
Perky · mradermacher
Params103B
Context4K
Smallest38.2 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · teleprint-me
Params6.74B
Context4K
Smallest13.5 GB
GGUF
WI
WizardLM 13B v1.2
Wizardlm · Sethblocks
Params13B
Context2K
Smallest7.3 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · wolflycanorcant
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TR
Trinity 13B
Trinity · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
NO
BasicEconomics SpicyBoros 2.2 7B QLORA v0.1
Nomic · adamo1139
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YO
Rinna Youri 7b
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
LL
Lt Llama 2 7b instruct hf Q4 K M
Llama · Cheatmeal
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Hf
Llama · nil471
Params6.74B
Context4K
Smallest2.5 GB
GGUF
WI
WizardCoder Python 34B V1.0 Q5 K M
Wizardcoder · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
Coding
SA
Sarah_StoryTeller_13b_HF
Sarah · FPHam
Params13B
Context4K
Smallest10.7 GB
GGUF
GO
Goliath 120b
Goliath · mradermacher
Params118B
Context4K
Smallest43.2 GB
GGUF
OP
openchat v3.2 Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama 2 13b Guanaco QLoRA
Llama · nitsuai
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing