GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
SW
Swallow 70b NVE RP i1
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LE
LearningOpt pie hq selfplay 7b
Learningopt · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama2 13B ShiningValiant
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
TO
tora 13B v1.0
Tora · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
BI
BigLiz 120b
Bigliz · mradermacher
Params118B
Context4K
Smallest43.6 GB
LL
SparseGPT pruned Llama 2 7b 0.3
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
BU
bubo bubo 13b
Bubo · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Kukedlc Llama 7b spanish
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Mistral Class Shishya 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PS
SnakyMcSnekFace/Psyfighter2-13B-vore
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
ShaderLLM CodeLlama 13b it
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
XW
Xwin Math 13B V1.0
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LA
Labradorite 13b
Labradorite · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gembo v1 70b i1
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Naphula__DarkForest 20B v2.0 Erebus Edition
Llama · Naphula
Params20B
Context4K
Q4_K_M12.0 GB
TR
Trillama 8B
Trillama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
Vicuna 13b v1.5
Vicuna · shahzeb171
Params13B
Context4K
Smallest4.9 GB
LL
Llammas
Llammas · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llava v1.5 7b
LLaVA · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
mistral 7b v5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
I Code NousLlama7B slerp
Code · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
SA
SambaLingo Japanese Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
IF
IFpromptMKR 7b L2 gguf q4 k m
Ifpromptmkr · impactframes
Params6.74B
Context4K
Q4_K_M4.1 GB
PY
Pygmalion 2 13b
Pygmalion · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
XW
Xwin LM 7B V0.1
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
XU
Xuanyuan_6B
Xuanyuan · mradermacher
Params6.39B
Context8K
Q4_K_M3.9 GB
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PU
PULI LlumiX 32K i1
Puli · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
ELYZA-japanese-Llama-2-7b-fast-instruct
Llama · opparco
Params6.85B
Context4K
Q4_K_M4.2 GB
SN
SnowyRP FinalV1 L2 13B
Snowyrp · backyardai
Params13B
Context4K
Q4_K_M7.9 GB