GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
EV
EverythingLM 13b V2 16k
Everythinglm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SA
Samantha 1.11 13B
Samantha · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
rombodawg_losslessmegacoder-llama2-13b-mini
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Coding
LL
nousresearch_yarn-llama-2-7b-128k
Llama · TheBloke
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
SP
Spicyboros 13B 2.2
Spicyboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
AT
athene noctua 13b
Athene · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Reasoning
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SY
Synthia 70B v1.1 i1
Synthia · mradermacher
Params69B
Context2K
Q4_K_M41.7 GB
GGUF
SW
Swallow-7b-instruct-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
WI
wizardlm_wizardmath-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
XW
xwin-lm_xwincoder-13b
Xwincoder · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
ST
strix rufipes 70b
Strix · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AR
arcane 7b i1
Arcane · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Reasoning
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GI
giant macaroni 120b i1
Giant · mradermacher
Params120B
Context4K
Smallest26.1 GB
GGUF
ON
Oni-7B-slerp
Oni · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
FA
Fairy2i W2
Fairy · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WinterGoddess 1.4x 70b 32k i1
Wintergoddess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
OpenMath CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
RO
RoLlama2 7b Base
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openthaigpt 1.0.0 7b chat
Openthaigpt · openthaigpt
Params6.81B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Samantha 1.11 CodeLlama 34B
Llama · second-state
Params33.7B
Context2K
Q4_K_M20.2 GB
Coding

Keep browsing