GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
SynthIQ 7b
Synthiq · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LM
lmsys vicuna 13b v1.5 16k
Lmsys · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama-3-8b-instruct
Llama · phymbert
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
persona generator llama 2 7b qlora merged
Llama · danlou
Params6.74B
Context4K
Smallest3.8 GB
GGUF
SY
Uukuguy SynthIA 7B v1.3 Dare 0.85
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AT
athene noctua 13b
Athene · tensorblock
Params13B
Context4K
Smallest4.9 GB
Reasoning
AI
airoboros l2 13b 2.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama 3 merge disco neural pace
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LD
Kaeri Jenti LDCC With Openorca2
Ldcc · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
llama quant models
Llama · amd-shark
Params6.74B
Context4K
Smallest13.5 GB
GGUF
LL
DaringFortitude
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 7b Hf
Llama · amgdev9
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
CHIH HUNG llama 2 13b FINETUNE1 17w r4
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
XU
XuanYuan2 70B Chat
Xuanyuan · mradermacher
Params69.1B
Context16K
Q4_K_M41.5 GB
GGUF
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QR
Qra 13b
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
KI
Mythalion Kimiko v2
Kimi · WhoTookMyAmogusNickname
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA Japanese CodeLlama 7b Instruct
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
AI
Airoboros L2 70b 3.1.2
Airoboros · tensorblock
Params69B
Context4K
Smallest25.5 GB
GGUF
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Codellama 13b Oasst Sft v10
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
JA
Stabilityai Japanese Stablelm Base Beta 70b
Japanese · tensorblock
Params69B
Context4K
Smallest25.5 GB
GGUF
LL
TheBloke CodeLlama 7B Fp16
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
XW
Xwin longLORA 70b rope8 32k fp16
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VE
Venus 103b v1.2
Venus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
SH
ShaderLLM v2 13b
Shaderllm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TE
Tess 70B v1.6
Tess · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Uukuguy Speechless Codellama 34b v1.9
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
ft 2 codellama merged Q4 K M
Llama · LDES777
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing