GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 ko 7B Chat
Llama · 24bean
Params6.86B
Context2K
Smallest7.3 GB
GGUF
SA
SambaLingo Japanese Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
EL
elyza fork2 i1
Elyza · mradermacher
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
PI
Pie All Uncon 13b
Pie · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
HA
HachiML youri 2x7b v0.2
Hachiml · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
LL
Llama 2 7b dpo 10k
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Tamil Llama 13b Instruct v0.1
Llama · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
LL
malayalam llama 7b instruct v0.1
Llama · abhinand
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
malayalam llama 7b instruct v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
GGUF
LL
Telugu Llama2 7B v0 Instruct
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
Meditron 7b
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Grafted Llama2 2x70B
Llama · mradermacher
Params125B
Context4K
Smallest25.9 GB
GGUF
TE
Tess XL v1.0
Tess · TheBloke
Params118B
Context4K
Smallest49.6 GB
GGUF
LL
LLaMA2 13B Psyfighter2 Erebus3 DareTies
Llama · DaveGergern
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Aurora Nights 103B v1.0
Aurora · mradermacher
Params103B
Context4K
Smallest37.9 GB
GGUF
TR
Trinity 13B
Trinity · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Codellama 7b Hf SFT GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
PS AD O365 CodeLlama 7B 05 QLoRA
Llama · adamo1139
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SW
Swallow MoE 2x13B v0.1
Swallow · mradermacher
Params21.6B
Context4K
Q4_K_M13.1 GB
GGUF
LL
LLaMA2 13B Psyfighter2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
llama 213 chat
Llama · kalpsnuti
Params13B
Context4K
Smallest9.2 GB
GGUF
LA
Law Chat
Law · hellork
Params6.74B
Context4K
Smallest3.6 GB
GGUF
LL
MaLA LM Emma 500 Llama2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Instruct Llama70B Dolly15k
Llama · mradermacher
Params69B
Context4K
Smallest25.5 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · trizze
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AI
Airoboros L2 7b 2.2.1
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DU
DuckDB NSQL 7B v0.1
Duckdb · motherduckdb
Params6.74B
Context16K
Smallest7.2 GB
GGUF
DO
DolphinHermes 120b
Dolphinhermes · mradermacher
Params120B
Context4K
Smallest44.5 GB
Tool use
RA
Rank_Vicuna_7B_V1_Fp16
Rank · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Embedding

Keep browsing