GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
leolm_leo-hessianai-70b-chat
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
MoMo 70B V1.1
Momo · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-7b-instruct-v0.1
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
CA
Camel Platypus2 13B
Camel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AE
aegolius acadicus v1 30b i1
Aegolius · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
TA
TableLLM 13b
Tablellm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CodingReasoning
PS
Psyfighter2 13B Vore
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
malhajar_meditron-7b-chat
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 70B Instruct
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
AI
airoboros l2 70b 2.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
SW
Swallow-7b-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JA
Jais adapted 7B Reflection Tuning Natural Farmer
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
DO
Dolphin 2.1 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IN
Inkbot 13B 4k
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 7B vietnamese 20k
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
ME
medicine chat
Medicine · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SY
migtissera_synthia-70b-v1.5
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AG
agentlm 7B
Agentlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
FA
FashionGPT 70B v1.2
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YO
Youri 7b
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 13B Instruct
Llama · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding

Keep browsing