GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
neverending text premium
Tiefighter · MRA-Labs
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
SP
spicyboros 13b 2.2
Spicyboros · jondurbin
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
bangla llama 13b instruct v0.1
Llama · BanglaLLM
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
HE
Hesperus-v1-13B-L2-fp16
Hesperus · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
Meditron 7b
Meditron · AL-DN
Params6.74B
Context2K
Smallest3.8 GB
GGUF
AL
alpaca-lora-65B.ggmlv3.q4_K_M.bin
Alpaca · mirek190
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
VI
Vinallama 7b Q4 K M
Vinallama · TrinhChou1102
Params6.86B
Context4K
Smallest13.7 GB
GGUF
XW
Xwin LM Xwin LM 13B V0.2
Xwin · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
CodeLlama 7b Hf
Llama · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
LL
Llama 2 7b chat mental health
Llama · sania963
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VE
testrepo
Venus · mradermacher
Params—
Context—
Smallest0.0 GB
GGUF
SA
SambaLingo-Hungarian-Base
Sambalingo · zsolx2
Params6.95B
Context4K
Smallest4.0 GB
GGUF
LL
Llama 2 7b Hf
Llama · Vincent-Fan
Params6.74B
Context4K
Smallest3.9 GB
GGUF
PR
protectai models Retr0REG Whats up gguf 2
Protectai · retroboy3000
Params620M
Context32K
Smallest0.3 GB
Coding
TT
ttLlama 7b
Ttllama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GGUF
TO
ToolBench ToolLLaMA 2 7b.Q6 K
Toolbench · PsiPi
Params6.74B
Context4K
Smallest5.5 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · POWERHACK
Params6.74B
Context4K
Smallest4.7 GB
GGUF
LL
Luau Codellama 7b Reasoning
Llama · darwinkernelpanic
Params7B
Context16K
Smallest0.0 GB
CodingReasoning
LL
KaeriJenti Ko Llama2 13b Platypus
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
quantize llama2
Llama · Junn17
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Lt Llama 2 7b instruct hf Q4 K M
Llama · OMCA8UP9
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llemma_7b
Llemma · Srinath-Pulaverthi
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
GR
Grafted Titanic Dolphin 2x120B
Grafted · RichardErkhov
Params240B
Context4K
Q4_K_M129.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · irresistiblegrace97
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MN
Msy127 Mnsim Dpo Peftmerged 2 Eos
Mnsim · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
AI
aixsatoshi Honyaku 13b
Aixsatoshi · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SY
Migtissera Synthia 7B
Synthia · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
HY
HyperLlama2Base
Hyperllama · HyperdustProtocol
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
H2Ogpt 4096 Llama2 13b Chat
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
ME
Meditron 7B Instruct
Meditron · AL-DN
Params6.74B
Context2K
Smallest3.8 GB
GGUF

Keep browsing