GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
TI
neverending text premium
Tiefighter · MRA-Labs
Params20B
Context4K
Q4_K_M12.0 GB
SP
spicyboros 13b 2.2
Spicyboros · jondurbin
Params13B
Context4K
Q4_K_M7.9 GB
LL
bangla llama 13b instruct v0.1
Llama · BanglaLLM
Params13.2B
Context4K
Q4_K_M8.0 GB
HE
Hesperus-v1-13B-L2-fp16
Hesperus · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ME
Meditron 7b
Meditron · AL-DN
Params6.74B
Context2K
Smallest3.8 GB
AL
alpaca-lora-65B.ggmlv3.q4_K_M.bin
Alpaca · mirek190
Params65.3B
Context2K
Q4_K_M39.3 GB
VI
Vinallama 7b Q4 K M
Vinallama · TrinhChou1102
Params6.86B
Context4K
Smallest13.7 GB
XW
Xwin LM Xwin LM 13B V0.2
Xwin · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
CodeLlama 7b Hf
Llama · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
LL
Llama 2 7b chat mental health
Llama · sania963
Params6.74B
Context4K
Smallest2.5 GB
VE
testrepo
Venus · mradermacher
Params—
Context—
Smallest0.0 GB
SA
SambaLingo-Hungarian-Base
Sambalingo · zsolx2
Params6.95B
Context4K
Smallest4.0 GB
LL
Llama 2 7b Hf
Llama · Vincent-Fan
Params6.74B
Context4K
Smallest3.9 GB
PR
protectai models Retr0REG Whats up gguf 2
Protectai · retroboy3000
Params620M
Context32K
Smallest0.3 GB
TT
ttLlama 7b
Ttllama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
TO
ToolBench ToolLLaMA 2 7b.Q6 K
Toolbench · PsiPi
Params6.74B
Context4K
Smallest5.5 GB
VI
Vicuna 7b v1.5
Vicuna · POWERHACK
Params6.74B
Context4K
Smallest4.7 GB
LL
Luau Codellama 7b Reasoning
Llama · darwinkernelpanic
Params7B
Context16K
Smallest0.0 GB
LL
KaeriJenti Ko Llama2 13b Platypus
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
quantize llama2
Llama · Junn17
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Lt Llama 2 7b instruct hf Q4 K M
Llama · OMCA8UP9
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llemma_7b
Llemma · Srinath-Pulaverthi
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Grafted Titanic Dolphin 2x120B
Grafted · RichardErkhov
Params240B
Context4K
Q4_K_M129.1 GB
LL
Llama 2 7b Chat Hf
Llama · irresistiblegrace97
Params6.74B
Context4K
Q4_K_M4.1 GB
MN
Msy127 Mnsim Dpo Peftmerged 2 Eos
Mnsim · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
AI
aixsatoshi Honyaku 13b
Aixsatoshi · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
SY
Migtissera Synthia 7B
Synthia · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
HY
HyperLlama2Base
Hyperllama · HyperdustProtocol
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
H2Ogpt 4096 Llama2 13b Chat
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
ME
Meditron 7B Instruct
Meditron · AL-DN
Params6.74B
Context2K
Smallest3.8 GB