GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
SE
SeewebLLM it Q4 K M
Seewebllm · antoste
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llama 2 obama epoch 15
Llama · clt013
Params6.74B
Context4K
Smallest7.2 GB
LL
Llama 2 7b Chat Hf
Llama · atahmih
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
Vicuna 7b v1.5
Vicuna · RajShah-1
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Kaeri Jenti Llama 2 Kor 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
TR
Trinity 13B
Trinity · yee-nah
Params13B
Context16K
Q4_K_M7.9 GB
MY
Mythalion 13b
Mythalion · namelessai
Params13B
Context4K
Q4_K_M7.9 GB
MI
Misal-7B-instruct-v0.1-GGUF
Misal · smallstepai
Params6.86B
Context4K
Smallest4.9 GB
RA
rank vicuna 7b v1 q8 0
Rank · castorini
Params6.74B
Context4K
Smallest7.2 GB
AB
aboki
Aboki · mannir
Params6.74B
Context4K
Smallest3.8 GB
MA
Magicoder S CL 7B
Magicoder · eramax
Params6.74B
Context16K
Smallest4.8 GB
LL
CodeLlama 13b Python Hf
Llama · jacobcarajo
Params13B
Context16K
Smallest9.2 GB
LL
Zyh3826 Llama2 13b Ft Openllm Leaderboard v1
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
VI
vicuna 13b v1.5
Vicuna · yargpt
Params13B
Context4K
Smallest13.8 GB
TO
ToRoLaMa 7b v1.0
Torolama · mradermacher
Params6.86B
Context4K
Q4_K_M4.2 GB
QR
OPI PG Qra 7b
Qra · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
BI
BigWeave v12 90b Q 3 L
Bigweave · llmixer
Params87.8B
Context4K
Smallest46.0 GB
LL
Llama 2 13b Hf
Llama · Cheatmeal
Params13B
Context4K
Smallest7.4 GB
ST
stairolz 70b
Stairolz · uncensorie
Params69B
Context4K
Smallest39.1 GB
MY
Mythalion 13b
Mythalion · ekchatzi-core
Params13B
Context4K
Q4_K_M7.9 GB
SH
ShareGPT4V
Sharegpt · Galunid
Params6.74B
Context4K
Smallest13.5 GB
ES
EstopianMaid-13B
Estopianmaid · Ransss
Params13B
Context4K
Smallest10.7 GB
LL
tianyil1 denas llama2
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GA
Gaby A1
Gaby · JAPSOAS
Params1.72B
Context40K
Smallest1.1 GB
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
MI
miqu 1 70b iMat IKL CQ
Miqu · NexesQuants
Params69B
Context32K
Smallest21.7 GB
ST
stairolzlv 70b
Stairolzlv · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SH
Shearedplats 2.7B v1
Shearedplats · Aryanne
Params2.7B
Context4K
Q4_K_M1.6 GB
XW
Xwin LM 7B V0.1
Xwin · firelzrd
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
codellama_codellama-7b-python-hf
Llama · 404-OS
Params6.74B
Context16K
Smallest3.8 GB