GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
Airavata
Airavata · dhruvk29
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
VI
vicuna-13b-v1.5
Vicuna · cminja
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Sheared LLaMA 1.3B Pruned
Llama · tensorblock
Params1.35B
Context4K
Smallest0.6 GB
GGUF
KO
komodo7b sunda lemes
Komodo · SutanRifkyt
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
SH
Shoppal v0.1 Sf
Shoppal · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DO
doctor assistant lama 7b
Doctor · elprofessor67
Params6.74B
Context2K
Smallest4.1 GB
GGUF
AU
aurelian alpha0.1 70b rope8 32K
Aurelian · Noeda
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ES
EstopianMaid 13B Q5 K M
Estopianmaid · SzilviaB
Params13B
Context4K
Smallest9.2 GB
Roleplay
PR
ProTrix
Protrix · Jonah-M
Params6.74B
Context4K
Smallest4.8 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · atahmih
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · jorgedelpozolerida
Params6.74B
Context4K
Smallest7.2 GB
GGUF
SP
Spicyboros 7b 2.2
Spicyboros · 0r4ngy
Params6.74B
Context4K
Smallest2.9 GB
GGUF
ME
meditron-7b
Meditron · joshnader
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CO
cognitivecomputations DolphinHermes 120b
Cognitivecomputations · RichardErkhov
Params120B
Context4K
Smallest44.2 GB
Tool use
LL
Llama 2 Ko OpenOrca Gugugo 13B
Llama · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
GGUF
BI
BigWeave v9 90b
Bigweave · RichardErkhov
Params87.8B
Context4K
Q4_K_M52.6 GB
GGUF
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.8 GB
GGUF
DO
DoxyLLamaShort
Doxyllamashort · LukasSonn
Params33.7B
Context16K
Smallest35.9 GB
GGUF
LL
Lt Llama 2 7b instruct hf Q6 K
Llama · kaukole
Params6.74B
Context4K
Smallest5.5 GB
GGUF
LL
Wanda pruned Llama 2 7b 0.7
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
my codellama experience model
Llama · sujalgawas
Params6.74B
Context16K
Smallest4.1 GB
Coding
PY
PygWin 2x7B FP16
Pygwin · Kquant03
Params11.1B
Context4K
Smallest22.1 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Medhaja
Params6.74B
Context4K
Smallest7.2 GB
GGUF
SA
SambaLingo Thai Chat
Sambalingo · nnch
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
DO
Vihangd Dopeyshearedplats 2.7b v1
Dopeyshearedplats · tensorblock
Params2.7B
Context4K
Smallest1.0 GB
GGUF
LL
tap ft codellama merge Q4 K M
Llama · LDES777
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
EvolCodeLlama 7b
Llama · ani-kavle
Params6.74B
Context16K
Smallest4.8 GB
Coding
LL
LLaMA2 13B Tiefighter
Llama · Geonyon
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
vicuna-13b-v1.5
Vicuna · justin-turner
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
qwen1.5 llm
Qwen · TrinhChou1102
Params2.77B
Context4K
Smallest5.6 GB
GGUF

Keep browsing