GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
SeewebLLM it Q4 K M
Seewebllm · antoste
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 obama epoch 15
Llama · clt013
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · atahmih
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · RajShah-1
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Kaeri Jenti Llama 2 Kor 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
TR
Trinity 13B
Trinity · yee-nah
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
MY
Mythalion 13b
Mythalion · namelessai
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Misal-7B-instruct-v0.1-GGUF
Misal · smallstepai
Params6.86B
Context4K
Smallest4.9 GB
GGUF
RA
rank vicuna 7b v1 q8 0
Rank · castorini
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AB
aboki
Aboki · mannir
Params6.74B
Context4K
Smallest3.8 GB
GGUF
MA
Magicoder S CL 7B
Magicoder · eramax
Params6.74B
Context16K
Smallest4.8 GB
Coding
LL
CodeLlama 13b Python Hf
Llama · jacobcarajo
Params13B
Context16K
Smallest9.2 GB
Coding
LL
Zyh3826 Llama2 13b Ft Openllm Leaderboard v1
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
VI
vicuna 13b v1.5
Vicuna · yargpt
Params13B
Context4K
Smallest13.8 GB
GGUF
TO
ToRoLaMa 7b v1.0
Torolama · mradermacher
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
QR
OPI PG Qra 7b
Qra · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BI
BigWeave v12 90b Q 3 L
Bigweave · llmixer
Params87.8B
Context4K
Smallest46.0 GB
GGUF
LL
Llama 2 13b Hf
Llama · Cheatmeal
Params13B
Context4K
Smallest7.4 GB
GGUF
ST
stairolz 70b
Stairolz · uncensorie
Params69B
Context4K
Smallest39.1 GB
GGUF
MY
Mythalion 13b
Mythalion · ekchatzi-core
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
ShareGPT4V
Sharegpt · Galunid
Params6.74B
Context4K
Smallest13.5 GB
Vision
ES
EstopianMaid-13B
Estopianmaid · Ransss
Params13B
Context4K
Smallest10.7 GB
Roleplay
LL
tianyil1 denas llama2
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GA
Gaby A1
Gaby · JAPSOAS
Params1.72B
Context40K
Smallest1.1 GB
ReasoningTool use
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
GGUF
MI
miqu 1 70b iMat IKL CQ
Miqu · NexesQuants
Params69B
Context32K
Smallest21.7 GB
GGUF
ST
stairolzlv 70b
Stairolzlv · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SH
Shearedplats 2.7B v1
Shearedplats · Aryanne
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
XW
Xwin LM 7B V0.1
Xwin · firelzrd
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
codellama_codellama-7b-python-hf
Llama · 404-OS
Params6.74B
Context16K
Smallest3.8 GB
Coding

Keep browsing