GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LE
LeetCodeWizard 13B v1.1a
Leetcodewizard · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
firefly llama2 13B chat
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
RO
Rose 20B i1
Rose · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
GE
em german 70b v01
German · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros L2 13b 3.0
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XW
xwin-lm_xwincoder-34b
Xwincoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
em german 13b v01
German · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
StableBeluga 13B
Stablebeluga · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JA
JanniesBasedLigma L2 13B
Janniesbasedligma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GO
GodziLLa2 70B
Godzilla · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 13B SuperCOT weighed
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
Canarim 7b
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DE
DetoxLLM 7B i1
Detoxllm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 PeanutButter v19 R8 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
migtissera_synthia-7b
Migtissera · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CA
Canarim 7b
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Arabic Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Opencsg codeLlama 7b v0.2
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
XW
Xwin Math 70B V1.1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
jondurbin_airoboros-c34b-2.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
PA
pipizhao_pandalyst_13b_v1.0
Pandalyst · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
OpenMath-CodeLlama-13b-Python-hf
Llama · Mungert
Params13B
Context16K
Q4_K_M7.8 GB
Coding
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
SA
SambaLingo Arabic Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
AI
Airoboros C34B 3.1.2
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
openbuddy llama2 70B v13 base
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
DE
DeciLM 6b Instruct
Decilm · mradermacher
Params5.72B
Context4K
Q4_K_M3.4 GB
GGUF
DE
DeciLM 6b
Decilm · mradermacher
Params5.72B
Context4K
Q4_K_M3.4 GB
GGUF

Keep browsing