GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
PygWin 2x7B
Pygwin · mradermacher
Params11.1B
Context4K
Q4_K_M6.9 GB
GGUF
XU
XuanYuan 6B
Xuanyuan · RichardErkhov
Params6.39B
Context8K
Q4_K_M3.9 GB
GGUF
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
SU
Superswallow 7b v0.3
Superswallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.2
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Samantha 1.11 13b i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TO
ToRoLaMa 7B
Torolama · ndthai
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
CO
coma-7B-v0.1
Coma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openthaigpt 1.0.0 70b chat
Openthaigpt · openthaigpt
Params69.1B
Context2K
Smallest41.5 GB
GGUF
MA
Magicoder S CL 7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Midnight Rose 70B v2.0.3
Midnight · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.5
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
bangla llama 7b instruct v0.1
Llama · BanglaLLM
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
LL
WizardLM 1.0 Uncensored Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 34B Python Fp16
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
LLaMA Pro 8B
Llama · mradermacher
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
SA
SambaLingo Russian Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
ER
ereb test
Ereb · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
SA
SambaLingo Arabic Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SA
saiga2 13b
Saiga · IlyaGusev
Params13B
Context2K
Smallest5.4 GB
GGUF
HA
HachiML youri 2x7b v0.2
Hachiml · mmnga
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
NO
Nous Hermes Platypus2 13B QLoRA 0.80 Epoch
Nous · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
BO
boana 7b instruct i1
Boana · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
Llammas Base
Llammas · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
XwinCoder 7B
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
XW
Xwin LM 7B V0.1 i1
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HE
Hesperus-v1-13B-L2-fp16
Hesperus · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Vbd Llama2 7B 50b Chat
Llama · RichardErkhov
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 13b chat norwegian
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Midnight Rose 70B v1.0
Midnight · Artefact2
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing