GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
CodeRosa 70B AB1
Coderosa · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
Coding
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LLaMA 2 7B 32K
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
WI
WizardCoder Python 7B v1.0
Wizardcoder · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
SU
Superkarakuri lm chat 70b v0.1
Superkarakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
GGUF
MO
MoMo 70B V1.1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LA
Labradorite 13b
Labradorite · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA japanese CodeLlama 7b instruct
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
LLaMA2 13B Erebus v3
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-13b-NVE-hf
Swallow · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M42.3 GB
GGUF
LL
OpenMath CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Taiwan LLaMa v1.0
Llama · audreyt
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PA
pipizhao_pandalyst-7b-v1.2
Pandalyst · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 2 7b EAX
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
LeetCodeWizard 7B V1.1
Leetcodewizard · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · mmnga
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Solana CodeLlama 7B v1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama-2-7B
Llama · ggml-org
Params6.74B
Context4K
Smallest3.8 GB
GGUF
CO
CodeMate v0.1
Codemate · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
WH
WhiteRabbitNeo 13B
Whiterabbitneo · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
LLaMA2 13B TiefighterLR
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
WizardLM 1.0 Uncensored CodeLlama 34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 2 7B 32K Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
PS
13B-Psyfighter2-Erebus3-DareTies
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GA
Gaja v1.00 i1
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Japanese Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SW
Swallow-7b-plus-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing