GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
Tat Llm 7b Fft
Tat · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
Copus 2x8B
Copus · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
SW
Swallow MoE 2x13B v0.1 i1
Swallow · mradermacher
Params21.6B
Context4K
Q4_K_M13.1 GB
GGUF
LL
llama 2 7b monika v0.3b i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 13b Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
RE
ReluLLaMA 7B
Relullama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
LLama3 Gaja Hindi 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llammas
Llammas · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Serbian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
XW
Xwin Math 7B V1.0
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
tora 70B v1.0
Tora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
XU
Duxiaoman DI XuanYuan 13B Chat
Xuanyuan · tastypear
Params13.1B
Context8K
Q4_K_M7.9 GB
GGUF
LL
llava v1.5 7b gpt4OCR hf GGUF Q2 K
LLaVA · nnethercott
Params6.74B
Context4K
Smallest2.5 GB
Vision
SA
SambaLingo Hungarian Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
BI
BigWeave v12 90b
Bigweave · mradermacher
Params87.8B
Context4K
Smallest32.6 GB
GGUF
GI
Giraffe 13b 32k v3
Giraffe · mradermacher
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
MA
Masterjp123 SnowyRP FinalV1 L2 13B
Masterjp · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PE
perky 70b v0.1 i1
Perky · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
GO
Goliath longLORA 120b rope8 32k fp16
Goliath · TheBloke
Params118B
Context4K
Smallest43.2 GB
GGUF
AI
Airoboros L2 13b 3.0
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QR
Qra 13b
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 7b 2.2
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Russian Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
lgaalves llama 2 13b hf platypus
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chronomaid Storytelling 13b
Chronomaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 70b RP i1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
Roleplay
LL
LLaMA2-13B-Erebus-v3
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama2 Megamerge Dare 13b v2
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
meditron 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GE
jphme/em_german_13b_v01
German · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing