GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
EV
EverythingLM 13b V2 16k
Everythinglm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TE
TeeZee Xwin LM 70B V0.1 Limarpv3
Teezee · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 34b Uncode
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
controllable-llama2-7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QR
Qra 13b
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
LL
Llama2 13B Eugeneparkthebest
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Cognitive-Lab/LLama3-Gaja-Hindi-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
uukuguy/speechless-thoughts-mistral-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Code Millenials 34b
Code · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llamandement 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
Code Millenials 34b
Code · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QR
Qra 13b
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Midnight Rose 103B v2.0.3
Midnight · mradermacher
Params103B
Context4K
Smallest38.2 GB
GGUF
SW
Swallow 70b NVE RP
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
MI
Misal 7B Instruct v0.1
Misal · RichardErkhov
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
QR
TeeZee/Qra-13b-instruct
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMAntino 2 70b Hf UltraChat ITA
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
YiffyEstopianMaid 13B
Yiffyestopianmaid · boxomcfoxo
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
LL
Opencsg CodeLlama 34b v0.1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llava v1.5 7b
LLaVA · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
AI
airoboros l2 13b 3.1.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
KoboldAI/LLaMA2-13B-Erebus-v3
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QR
TeeZee/Qra-13B-chat
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
Goliath longLORA 120b rope8 32k fp16
Goliath · mradermacher
Params118B
Context4K
Smallest43.2 GB
GGUF
MI
PJ MINI MODEL FINAL
Mini · mradermacher
Params1.38B
Context2K
Q4_K_M0.9 GB
GGUF
LL
Llama 2 7b Verse Bot
Llama · 247labs
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama3 openhermes 2.5 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QR
Qra 7b
Qra · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing