GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMAntino 2 13b hf ITA
Llama · nold
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Llamarine Hf
Llama · DSAKAI
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
XW
Xwin Math 70B V1.1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
kevin1010607 llama2 7b sft full llama2
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
saiga2 70b
Saiga · IlyaGusev
Params69B
Context4K
Smallest29.3 GB
Roleplay
YO
Rinna Youri 7b Chat
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SP
Spicyboros 7b 2.2
Spicyboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SU
Superswallow 70b v0.3
Superswallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
AI
Airoboros L2 13b 2.2.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PS
Psyfighter2 13B Vore
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
PJ Phayao Final NA JA
Phayao · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
CE
Cerpen 7B v0.1
Cerpen · mradermacher
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RE
ReluLLaMA 70B
Relullama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
PI
Pie Hq Selfplay 13b
Pie · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
PE
perky 103b v0.1 i1
Perky · mradermacher
Params103B
Context4K
Smallest22.0 GB
GGUF
OP
Openthaigpt 1.0.0 13b Chat
Openthaigpt · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
codellama 7b python ai assistant full
Llama · pranav-pvnn
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SP
spicyboros 70b 2.2
Spicyboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
DI
Dicephal 123B
Dicephal · mradermacher
Params124B
Context4K
Smallest45.7 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TE
Tess 70B v1.6
Tess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
KA
KafkaLM 70B German V0.1
Kafkalm · Maxdeepnu
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SO
SocialiteLlama
Socialitellama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LI
Lima Unchained 70b i1
Lima · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
SA
SambaLingo Japanese Chat
Sambalingo · LoneStriker
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
functioncall llama2 chat q3
Llama · jtatman
Params6.74B
Context4K
Smallest2.5 GB
GGUF
PL
Plutus 3B
Plutus · 0xroyce
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CO
Code Millenials 34b
Code · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Keep browsing