GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
EV
EverythingLM 13b V2 16k
Everythinglm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
SA
Samantha 1.11 13B
Samantha · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
rombodawg_losslessmegacoder-llama2-13b-mini
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-7b-128k
Llama · TheBloke
Params6.74B
Context128K
Q4_K_M4.1 GB
SP
Spicyboros 13B 2.2
Spicyboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
AT
athene noctua 13b
Athene · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
SY
Synthia 70B v1.1 i1
Synthia · mradermacher
Params69B
Context2K
Q4_K_M41.7 GB
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
WI
wizardlm_wizardmath-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
XW
xwin-lm_xwincoder-13b
Xwincoder · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
ST
strix rufipes 70b
Strix · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AR
arcane 7b i1
Arcane · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GI
giant macaroni 120b i1
Giant · mradermacher
Params120B
Context4K
Smallest26.1 GB
ON
Oni-7B-slerp
Oni · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
FA
Fairy2i W2
Fairy · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
WinterGoddess 1.4x 70b 32k i1
Wintergoddess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
LL
OpenMath CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
RO
RoLlama2 7b Base
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
openthaigpt 1.0.0 7b chat
Openthaigpt · openthaigpt
Params6.81B
Context4K
Q4_K_M4.1 GB
LL
Samantha 1.11 CodeLlama 34B
Llama · second-state
Params33.7B
Context2K
Q4_K_M20.2 GB