GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
EV
EverythingLM 13b V2 16k
Everythinglm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
TE
TeeZee Xwin LM 70B V0.1 Limarpv3
Teezee · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 2 34b Uncode
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
controllable-llama2-7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QR
Qra 13b
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ES
EstopianMaid 13B
Estopianmaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama2 13B Eugeneparkthebest
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Cognitive-Lab/LLama3-Gaja-Hindi-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
uukuguy/speechless-thoughts-mistral-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Code Millenials 34b
Code · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llamandement 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CO
Code Millenials 34b
Code · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
QR
Qra 13b
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
Midnight Rose 103B v2.0.3
Midnight · mradermacher
Params103B
Context4K
Smallest38.2 GB
SW
Swallow 70b NVE RP
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MI
Misal 7B Instruct v0.1
Misal · RichardErkhov
Params6.86B
Context4K
Q4_K_M4.2 GB
QR
TeeZee/Qra-13b-instruct
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaMAntino 2 70b Hf UltraChat ITA
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
YI
YiffyEstopianMaid 13B
Yiffyestopianmaid · boxomcfoxo
Params13B
Context4K
Q4_K_M7.9 GB
LL
Opencsg CodeLlama 34b v0.1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llava v1.5 7b
LLaVA · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
airoboros l2 13b 3.1.1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
KoboldAI/LLaMA2-13B-Erebus-v3
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QR
TeeZee/Qra-13B-chat
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GO
Goliath longLORA 120b rope8 32k fp16
Goliath · mradermacher
Params118B
Context4K
Smallest43.2 GB
MI
PJ MINI MODEL FINAL
Mini · mradermacher
Params1.38B
Context2K
Q4_K_M0.9 GB
LL
Llama 2 7b Verse Bot
Llama · 247labs
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llama3 openhermes 2.5 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QR
Qra 7b
Qra · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB