GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llamas-community_llamaguard-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LM
LMCocktail 10.7B v1
Lmcocktail · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
VI
Vigogne 2 13B Instruct
Vigogne · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-13b-chat-bilingual
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
EU
Euryale 1.3 longLORA 70b rope8 32k fp16 i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow-70b-instruct-v0.1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
TO
tokyotech llm Swallow 70b instruct v0.1
Tokyotech · mmnga
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
EU
Euryale 1.3 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llama 2 7B Guanaco QLoRA
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AI
Airoboros L2 70B 3.1.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow 70b Instruct v0.1
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.5 GB
GGUF
LL
CodeLlama 70b Instruct hf
Llama · second-state
Params69B
Context4K
Q4_K_M41.4 GB
Coding
WI
wizardlm_wizardcoder-python-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
WI
WizardCoder Python 34B V1.0 i1
Wizardcoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
AU
Augmental ReMM 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
uukuguy_speechless-code-mistral-7b-v1.0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
AI
bhenrym14_airoboros-l2-13b-2.1-yarn-64k
Airoboros · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-7b-NVE-instruct-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA Pro 8B
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
AI
jondurbin_airoboros-m-7b-3.1.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow 70B instruct
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LA
latxa-70b-v1.2
Latxa · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing