GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Karen TheEditor V2 CREATIVE Mistral 7B Q6 K
Mistral · FPHam
Params7.24B
Context32K
Smallest5.9 GB
GGUF
VE
Venus-120b-v1.1
Venus · mradermacher
Params120B
Context4K
Smallest25.2 GB
GGUF
XU
XuanYuan 13B
Xuanyuan · RichardErkhov
Params13.1B
Context8K
Q4_K_M7.9 GB
GGUF
CA
Doctor Shotgun CalliopeDS v2 L2 13B
Calliopeds · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
WI
vanillaOVO WizardMath 13B V1.0
Wizardmath · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
AI
Airocoder 34b 2.1
Airocoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llava v1.6
LLaVA · cortexso
Params6.74B
Context4K
Smallest4.1 GB
Vision
TE
k2s3 test 24001
Test · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SA
Sambanovasystems SambaLingo Thai Base
Sambalingo · tensorblock
Params6.95B
Context4K
Smallest2.7 GB
GGUF
LL
CodeLlama 34b Instruct hf
Llama · Userb1az
Params33.7B
Context16K
Smallest35.9 GB
Coding
ST
Stheno-Inverted-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BI
BigLiz 120b
Bigliz · bcse
Params118B
Context4K
Smallest43.2 GB
GGUF
CO
Danielbrdz CodeBarcenas 13b
Codebarcenas · tensorblock
Params13B
Context16K
Smallest4.9 GB
GGUF
LL
ELYZA Japanese Llama 2 13b Instruct
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
AI
Airavata
Airavata · sam749
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LA
latxa-7b-v1.2
Latxa · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
EU
Euryale 1.4 L2 70B
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Hpcai Tech Colossal LLaMA 2 7b Base
Llama · tensorblock
Params7.04B
Context4K
Smallest2.7 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · NexesQuants
Params70.6B
Context8K
Smallest31.6 GB
GGUF
VE
testrepo i1
Venus · mradermacher
Params810M
Context—
Smallest0.0 GB
GGUF
MO
monika ddlc 7b v1
Monika · 922-CA
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YA
Yakult 70B
Yakult · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Midnight Rose 70B v1.0
Midnight · LoneStriker
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
Medusa-1.3-L2-7B
Medusa · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
ELYZA Japanese Llama 2 7b Fast
Llama · tensorblock
Params6.85B
Context4K
Smallest2.6 GB
GGUF
LL
Meta Llama CodeLlama 13b Hf
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
ME
meow
Meow · wilson989
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
WI
WinterGoliath 123b
Wintergoliath · TheBloke
Params124B
Context4K
Smallest45.3 GB
GGUF
RE
ReMantik-L2-70B
Remantik · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7B instruct text2sql
Llama · support-pvelocity
Params7B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing