GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
CO
Danielbrdz CodeBarcenas 1b
Codebarcenas · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
XW
Xwin LM 70B V0.1 Limarpv3
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
LL
Llama 2 7B Chat
Llama · e-valente
Params6.74B
Context2K
Smallest3.8 GB
KA
KafkaLM 7B DARE_TIES LaserRMT QLoRA DPO v0.5
Kafkalm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
monuminu indo instruct llama2 13b
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
TR
senseable/Trillama-8B
Trillama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Tamil Llama 7b Instruct v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
LL
CodeLlama 7b Python Hf
Llama · alphaduriendur
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Speechlessai Speechless Mistral 7b Dare 0.85
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama 2 40 percent compression
Llama · PruningEverything
Params4.09B
Context4K
Smallest8.2 GB
LL
88_Llama2_32k_Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
AU
Aurora Nights 70B v1.0 IQ2
Aurora · Kooten
Params69B
Context4K
Smallest18.3 GB
OR
orthorus 125b moe i1
Orthorus · mradermacher
Params125B
Context2K
Smallest26.7 GB
SH
ShareGPT4V 13B quant
Sharegpt · cmp-nct
Params13B
Context4K
Smallest5.7 GB
LL
maximuslee07 llama 2 7b rockwell final
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
SA
SambaLingo Turkish Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
OR
Orca 2 13b
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
JA
Jais adapted 7B Reflection Tuning Natural Farmer Q4 K M
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
LL
CodeLlama 7B nlp pp
Llama · AshtonIsNotHere
Params6.74B
Context16K
Smallest7.2 GB
BO
boana 7b instruct
Boana · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GI
giant macaroni 120b
Giant · mradermacher
Params120B
Context4K
Smallest45.0 GB
ME
Medusa-1.3-L2-7B
Medusa · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
Storytime 13b
Storytime · tensorblock
Params13B
Context4K
Smallest4.9 GB
QR
Qra 13B chat
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
ST
Stheno-Inverted-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 7b Hf
Llama · HARRY07979
Params6.74B
Context16K
Q4_K_M4.1 GB
LE
13B Legerdemain L2
Legerdemain · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CH
chimera 120b i1
Chimera · mradermacher
Params120B
Context4K
Smallest26.1 GB
SA
samba 1.1B
Samba · Kearm
Params1.1B
Context2K
Q4_K_M0.7 GB