GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
Thespis 13B v0.3
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HU
Huginn 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 7b 2.2
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GA
Gaja v2.00 i1
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
CA
Canarim 7b Vestibulaide
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
DO
Dolphin 2.2 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DI
DiarizationLM 13b Fisher v1
Diarizationlm · google
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EL
Eli-Hindi-v0.1
Eli · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
PJ 7B MODEL FINAL
Model · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
codellama_codellama-7b-instruct-hf
Llama · DevShubham
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
openbuddy_openbuddy-llama2-13b64k-v15
Llama · TheBloke
Params13.1B
Context64K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13b Lemon Alpaca
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
sheep duck llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
GOAT 70B Storytelling
Goat · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PU
PULI LlumiX 32K instruct
Puli · ariel-ml
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
HU
Huginn 13B v4
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
OpenOrca Stx
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-13b-instruct-v0.1
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Arabic Base
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
ME
Medicine Chat
Medicine · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CA
Cat 13B 0.5
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Thai Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
AI
Airavata
Airavata · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 13B LoRA Assemble
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
CodeMate v0.1
Codemate · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
CL
claude2 alpaca 7B
Claude · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SP
Spicyboros c34b 2.2
Spicyboros · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
GGUF
SA
SambaLingo Hungarian Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
OpenMath CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Keep browsing