GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
LL
Llava v1.6 Vicuna 7B
LLaVA · second-state
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
synthia-70b-v1.1
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · second-state
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
AI
airoboros l2 13B 3.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
GGUF
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
SW
Swallow 7B Instruct
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
IN
Inkbot 13B 8k 0.2
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardLM 70B V1.0
Wizardlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
AI
airoboros l2 7B 2.2.1
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
LL
Code-Llama-2-13B-instruct-text2sql
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
VI
lmsys_vicuna-13b-v1.5-16k
Vicuna · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ME
epfl-llm_meditron-7b
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
TO
llm-agents_tora-code-13b-v1.0
Tora · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing