GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Swallow 70b NVE RP i1
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
LE
LearningOpt pie hq selfplay 7b
Learningopt · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
Llama2 13B ShiningValiant
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TO
tora 13B v1.0
Tora · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
BI
BigLiz 120b
Bigliz · mradermacher
Params118B
Context4K
Smallest43.6 GB
GGUF
LL
SparseGPT pruned Llama 2 7b 0.3
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BU
bubo bubo 13b
Bubo · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Kukedlc Llama 7b spanish
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Mistral Class Shishya 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PS
SnakyMcSnekFace/Psyfighter2-13B-vore
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ShaderLLM CodeLlama 13b it
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
XW
Xwin Math 13B V1.0
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LA
Labradorite 13b
Labradorite · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gembo v1 70b i1
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Naphula__DarkForest 20B v2.0 Erebus Edition
Llama · Naphula
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
TR
Trillama 8B
Trillama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · shahzeb171
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llammas
Llammas · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llava v1.5 7b
LLaVA · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
MI
mistral 7b v5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
I Code NousLlama7B slerp
Code · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
SA
SambaLingo Japanese Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
IF
IFpromptMKR 7b L2 gguf q4 k m
Ifpromptmkr · impactframes
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PY
Pygmalion 2 13b
Pygmalion · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XW
Xwin LM 7B V0.1
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XU
Xuanyuan_6B
Xuanyuan · mradermacher
Params6.39B
Context8K
Q4_K_M3.9 GB
GGUF
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PU
PULI LlumiX 32K i1
Puli · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-fast-instruct
Llama · opparco
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
SN
SnowyRP FinalV1 L2 13B
Snowyrp · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay

Keep browsing