GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
KA
Kaori 34B v1
Kaori · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
PM
PMaxxxer v1 70b
Pmaxxxer · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LD
Kaeri Jenti LDCC With Korca
Ldcc · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
PR
Premerge EX EX 123B
Premerge · mradermacher
Params124B
Context4K
Smallest45.7 GB
GGUF
LL
Llama 2 7b chat finetune UOBS
Llama · hassu619
Params1.75B
Context4K
Smallest3.5 GB
GGUF
AD
ADELIE SFT
Adelie · nvhf
Params6.74B
Context2K
Smallest5.5 GB
GGUF
LL
CHIH HUNG llama 2 13b OpenOrca 5w
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama-2-7b-chat-hf
Llama · zhentaoyu
Params6.74B
Context4K
Smallest3.9 GB
GGUF
VE
Venus-120b-v1.0
Venus · mradermacher
Params120B
Context4K
Smallest25.2 GB
GGUF
LL
ELYZA japanese Llama 2 13b instruct
Llama · bash11116
Params13B
Context4K
Smallest7.9 GB
GGUF
LL
japanese llama 2 13b
Llama · owner203
Params13.3B
Context2K
Smallest7.6 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · rockon1095
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
llama2 chat attck
Llama · chihhh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3.1_3B_GRPO
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CO
Code Millenials 13b
Code · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
LL
llama2 70b longlora 32k ROPE8
Llama · grimulkan
Params69B
Context4K
Smallest29.9 GB
GGUF
NS
nsfwthrowitaway69 Venus 120b v1.2
Nsfwthrowitaway · Ygolohcysp81
Params120B
Context4K
Smallest44.2 GB
GGUF
KO
Komodo 7b Base
Komodo · Kondara
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardCoder Python 34B V1.0 Q2 K
Wizardcoder · goodasdgood
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
LLaMA2 13B Tiefighter
Llama · newsletter
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
Llama 2 13b Lemon Alpaca
Llama · Stormtrooperaim
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PU
PULI LlumiX 32K
Puli · istvanpatai
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · mardakani
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
IB
ibivibiv bubo bubo 13b
Ibivibiv · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
PJ MINI MODEL FINAL
Mini · RichardErkhov
Params1.38B
Context2K
Q4_K_M0.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · jharis97
Params6.74B
Context4K
Smallest2.9 GB
GGUF
LL
spack llama 13b
Llama · daniellnichols
Params13B
Context16K
Smallest7.4 GB
Coding
LL
Llama-2-7b-chat-hf
Llama · Funny-Meow
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
leo hessionai 7B quotes
Leo · caretech-owl
Params6.74B
Context8K
Smallest7.2 GB
GGUF

Keep browsing