GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Kaeri Jenti Llama 2 Koen 13b v1.2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MO
MOdel2
Model · qq0823
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
NO
BasicEconomics SpicyBoros 2.2 7B QLORA v0.3
Nomic · adamo1139
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
codellama
Llama · ego-hf
Params6.74B
Context16K
Smallest27.0 GB
Coding
LL
Llama 2 7b Chat Hf
Llama · aistuffllm
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openchat v3.2 super Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Hungarian Chat
Sambalingo · Gusthy
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
bangla llama 13b base v0.1
Llama · BanglaLLM
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
XW
Aqweteddy Xwin 7b_chatvec Tulu2
Xwin · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
MetaMath 7B V1.0
Metamath · apage43
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · Liuzzyy
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Phind CodeLlama 34B Python v1
Llama · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
Coding
LL
Llama 2 13b Hf
Llama · stellali0115
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SP
spicyboros c34b 2.2 checkpoints
Spicyboros · jondurbin
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
Lt Llama 2 13b instruct hf Q8 0
Llama · jekyll2010
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
Uk Fraud Chatbot Llama2
Llama · misee
Params41M
Context—
Smallest0.2 GB
GGUF
LL
complete pipeline llama 2 20 percent compression GGUF Q4 K M
Llama · c2d-usp
Params5.39B
Context4K
Q4_K_M4.8 GB
GGUF
MI
Midnight Rose 103b v2.0.3
Midnight · RichardErkhov
Params103B
Context4K
Smallest37.9 GB
GGUF
LL
llama2 7b smoothquant
Llama · kkkevinnn
Params7B
Context4K
Smallest7.2 GB
GGUF
LL
Llama 2 13b chat hf
Llama · jeffmcc
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
sanghwa na llama2 13b.kor
Llama · RichardErkhov
Params13B
Context4K
Smallest4.9 GB
GGUF
PY
Pygmalion 2 13b
Pygmalion · wdidi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
phind codellama 34b v2.Q4 K M GGUF SPLIT
Llama · DanyDA
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
RE
ReluLLaMA 7B Q4 0
Relullama · haolv555
Params6.74B
Context2K
Smallest3.8 GB
GGUF
WI
WizardCoder 7b python Q4 0
Wizardcoder · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
MY
MythoMakise 13b quants
Mythomakise · Heralax
Params13B
Context—
Smallest9.2 GB
GGUF
SP
PS AD O365 SpicyBoros 7B 01
Spicyboros · adamo1139
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
vihat llama2
Llama · AITTS
Params6.88B
Context4K
Smallest13.8 GB
GGUF
MI
Karen TheEditor V2 CREATIVE Mistral 7B Q5 K S
Mistral · Clevyby
Params7.24B
Context32K
Smallest5.0 GB
GGUF
OR
Orca2 Nova 13B
Orca · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing