GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
Venus-120b-v1.1
Venus · mradermacher
Params120B
Context4K
Smallest44.2 GB
GGUF
GE
GELI Q4 K M
Geli · dondongwonlee
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 13b Chat Hf
Llama · jorgedelpozolerida
Params13B
Context4K
Smallest13.8 GB
GGUF
CH
chronob 1.4 lin 70b
Chronob · uncensorie
Params69B
Context4K
Smallest39.1 GB
GGUF
LL
Uukuguy Speechless Codellama Orca Airoboros 13b 0.10e
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · shinigami92g
Params13B
Context16K
Smallest7.4 GB
GGUF
VI
vicuna 13b v1.5 16k
Vicuna · Eric111
Params13B
Context4K
Smallest26.0 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · msyu1020
Params6.74B
Context4K
Smallest3.3 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · atahmih
Params6.74B
Context4K
Smallest3.8 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · rpp01
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama-3-8b
Llama · reach-vb
Params8.03B
Context8K
Smallest8.5 GB
GGUF
DO
doctor assistant olama 8b
Doctor · jiya59219
Params6.74B
Context2K
Smallest4.1 GB
GGUF
PH
PJ 13B PHAYAO LAW
Phayao · PisutDeekub
Params13.1B
Context4K
Smallest26.2 GB
GGUF
SH
ShareGPT4V 13B
Sharegpt · nakodanei
Params13B
Context4K
Q4_K_M7.9 GB
Vision
CO
CodeBarcenas 13b
Codebarcenas · Danielbrdz
Params13B
Context2K
Q4_K_M8.1 GB
GGUF
LL
Lt Llama 2 13b instruct hf Q4 K M
Llama · OMCA8UP9
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
ReluLLaMA-7B
Relullama · yichen0104
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SH
shearedplats 2.7b v2
Shearedplats · tensorblock
Params2.7B
Context4K
Smallest1.0 GB
GGUF
LL
Llamathan 3B Q4 K M
Llama · Hariharan05
Params3.21B
Context128K
Smallest2.0 GB
Tool use
ME
meditron-7b
Meditron · legionarius
Params6.74B
Context2K
Smallest5.5 GB
GGUF
FU
functionary 7b v1 Q8 0
Functionary · brucethemoose
Params6.74B
Context4K
Smallest5.5 GB
Tool use
VI
Vicuna 7b v1.5
Vicuna · LeyaGao
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
ChibiAsmAi Z80 13b
Llama · chibiakumas-com
Params13B
Context16K
Q4_K_M7.9 GB
Coding
AT
athena 120b
Athena · mradermacher
Params120B
Context4K
Smallest45.0 GB
GGUF
VI
Vinallama 2.7b
Vinallama · tensorblock
Params2.77B
Context4K
Smallest1.1 GB
GGUF
PH
PJ Phayao Semi Final
Phayao · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
VI
Vinallama 2.7b Chat
Vinallama · nguyenphuthien
Params2.77B
Context4K
Smallest2.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · msyu1020
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
llama-3-8b
Llama · Anoxiom
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LL
Llama 2 7b Hf
Llama · seungwon12
Params6.74B
Context4K
Smallest3.8 GB
GGUF

Keep browsing