GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
Swallow 7b Instruct Hf
Swallow · tensorblock
Params6.83B
Context4K
Smallest2.6 GB
GGUF
LL
OpenDolphinHermes Llama2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
LL
CodeLlama 13b Instruct Hf
Llama · bkoerner
Params13B
Context16K
Q4_K_M7.9 GB
Coding
PI
pie all uncon 7b
Pie · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
Norquinal Mistral 7B claude chat nsfw lora test
Mistral · sdasd112132
Params7.24B
Context32K
Smallest5.1 GB
GGUF
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
em german 7b v01
German · jphme
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Gujju Llama Instruct v0.1
Llama · mradermacher
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 7b Chat Hf_Fictional_Chinese_V1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
Airocoder 34b 2.1
Airocoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
TheBloke CodeLlama 34B Python Fp16
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
ST
Stheno-1.3-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Serbian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
TH
TheProfessor 155b i1
Theprofessor · mradermacher
Params155B
Context4K
Smallest32.4 GB
GGUF
LL
Codellama CodeLlama 70b Hf
Llama · tensorblock
Params69B
Context16K
Smallest25.5 GB
Coding
SA
Samantha 1.11 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
dragon llama answer tool
Llama · llmware
Params6.74B
Context4K
Smallest4.1 GB
Tool use
DU
DuckDB NSQL 7B v0.1
Duckdb · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GGUF
LL
CodeLlama 7b Hf
Llama · bkoerner
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
TA
Tai 70B
Tai · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
llama2 70b longlora fp16 32k ROPE8
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Codellama CodeLlama 34b Python Hf
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
ST
Stheno-Mix-L2-20B
Stheno · mradermacher
Params20.6B
Context4K
Q4_K_M12.4 GB
GGUF
PS
Psyfighter2-13B-vore_kto
Psyfighter · SnakyMcSnekFace
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
CalliopeDS v2 L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno L2 13B i
Stheno · SolidSnacke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
InnerI AI sn6 7B slerp
Inneri · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DU
dulia 13b 8k alpha
Dulia · tensorblock
Params13B
Context8K
Smallest4.9 GB
GGUF
VI
Vicuna Mmlu Val Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF

Keep browsing