GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
SY
SynthIQ 7b
Synthiq · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LM
lmsys vicuna 13b v1.5 16k
Lmsys · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama-3-8b-instruct
Llama · phymbert
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
persona generator llama 2 7b qlora merged
Llama · danlou
Params6.74B
Context4K
Smallest3.8 GB
SY
Uukuguy SynthIA 7B v1.3 Dare 0.85
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AT
athene noctua 13b
Athene · tensorblock
Params13B
Context4K
Smallest4.9 GB
AI
airoboros l2 13b 2.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama 3 merge disco neural pace
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LD
Kaeri Jenti LDCC With Openorca2
Ldcc · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
llama quant models
Llama · amd-shark
Params6.74B
Context4K
Smallest13.5 GB
LL
DaringFortitude
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 7b Hf
Llama · amgdev9
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
CHIH HUNG llama 2 13b FINETUNE1 17w r4
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
XU
XuanYuan2 70B Chat
Xuanyuan · mradermacher
Params69.1B
Context16K
Q4_K_M41.5 GB
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QR
Qra 13b
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
KI
Mythalion Kimiko v2
Kimi · WhoTookMyAmogusNickname
Params13B
Context4K
Q4_K_M7.9 GB
LL
ELYZA Japanese CodeLlama 7b Instruct
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
AI
Airoboros L2 70b 3.1.2
Airoboros · tensorblock
Params69B
Context4K
Smallest25.5 GB
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Codellama 13b Oasst Sft v10
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
JA
Stabilityai Japanese Stablelm Base Beta 70b
Japanese · tensorblock
Params69B
Context4K
Smallest25.5 GB
LL
TheBloke CodeLlama 7B Fp16
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
XW
Xwin longLORA 70b rope8 32k fp16
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
VE
Venus 103b v1.2
Venus · TheBloke
Params103B
Context4K
Smallest43.5 GB
SH
ShaderLLM v2 13b
Shaderllm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
TE
Tess 70B v1.6
Tess · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
LL
Uukuguy Speechless Codellama 34b v1.9
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
LL
ft 2 codellama merged Q4 K M
Llama · LDES777
Params6.74B
Context16K
Q4_K_M4.1 GB