GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
GGUF
CO
Danielbrdz CodeBarcenas 1b
Codebarcenas · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
GGUF
XW
Xwin LM 70B V0.1 Limarpv3
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Llama 2 7B Chat
Llama · e-valente
Params6.74B
Context2K
Smallest3.8 GB
GGUF
KA
KafkaLM 7B DARE_TIES LaserRMT QLoRA DPO v0.5
Kafkalm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
monuminu indo instruct llama2 13b
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TR
senseable/Trillama-8B
Trillama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Tamil Llama 7b Instruct v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · alphaduriendur
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Speechlessai Speechless Mistral 7b Dare 0.85
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama 2 40 percent compression
Llama · PruningEverything
Params4.09B
Context4K
Smallest8.2 GB
GGUF
LL
88_Llama2_32k_Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
AU
Aurora Nights 70B v1.0 IQ2
Aurora · Kooten
Params69B
Context4K
Smallest18.3 GB
GGUF
OR
orthorus 125b moe i1
Orthorus · mradermacher
Params125B
Context2K
Smallest26.7 GB
GGUF
SH
ShareGPT4V 13B quant
Sharegpt · cmp-nct
Params13B
Context4K
Smallest5.7 GB
Vision
LL
maximuslee07 llama 2 7b rockwell final
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SA
SambaLingo Turkish Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
OR
Orca 2 13b
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
JA
Jais adapted 7B Reflection Tuning Natural Farmer Q4 K M
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
LL
CodeLlama 7B nlp pp
Llama · AshtonIsNotHere
Params6.74B
Context16K
Smallest7.2 GB
Coding
BO
boana 7b instruct
Boana · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
GI
giant macaroni 120b
Giant · mradermacher
Params120B
Context4K
Smallest45.0 GB
GGUF
ME
Medusa-1.3-L2-7B
Medusa · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Storytime 13b
Storytime · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
QR
Qra 13B chat
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
ST
Stheno-Inverted-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 7b Hf
Llama · HARRY07979
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LE
13B Legerdemain L2
Legerdemain · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
chimera 120b i1
Chimera · mradermacher
Params120B
Context4K
Smallest26.1 GB
GGUF
SA
samba 1.1B
Samba · Kearm
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing