GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
AI
Airavata
Airavata · dhruvk29
Params6.87B
Context4K
Q4_K_M4.2 GB
VI
vicuna-13b-v1.5
Vicuna · cminja
Params13B
Context4K
Q4_K_M7.9 GB
LL
Sheared LLaMA 1.3B Pruned
Llama · tensorblock
Params1.35B
Context4K
Smallest0.6 GB
KO
komodo7b sunda lemes
Komodo · SutanRifkyt
Params6.76B
Context4K
Q4_K_M4.1 GB
SH
Shoppal v0.1 Sf
Shoppal · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
DO
doctor assistant lama 7b
Doctor · elprofessor67
Params6.74B
Context2K
Smallest4.1 GB
AU
aurelian alpha0.1 70b rope8 32K
Aurelian · Noeda
Params69B
Context4K
Q4_K_M41.4 GB
ES
EstopianMaid 13B Q5 K M
Estopianmaid · SzilviaB
Params13B
Context4K
Smallest9.2 GB
PR
ProTrix
Protrix · Jonah-M
Params6.74B
Context4K
Smallest4.8 GB
LL
Llama 2 7b Chat Hf
Llama · atahmih
Params6.74B
Context4K
Smallest7.2 GB
LL
Llama 2 7b Chat Hf
Llama · jorgedelpozolerida
Params6.74B
Context4K
Smallest7.2 GB
SP
Spicyboros 7b 2.2
Spicyboros · 0r4ngy
Params6.74B
Context4K
Smallest2.9 GB
ME
meditron-7b
Meditron · joshnader
Params6.74B
Context2K
Q4_K_M4.1 GB
CO
cognitivecomputations DolphinHermes 120b
Cognitivecomputations · RichardErkhov
Params120B
Context4K
Smallest44.2 GB
LL
Llama 2 Ko OpenOrca Gugugo 13B
Llama · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
BI
BigWeave v9 90b
Bigweave · RichardErkhov
Params87.8B
Context4K
Q4_K_M52.6 GB
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.8 GB
DO
DoxyLLamaShort
Doxyllamashort · LukasSonn
Params33.7B
Context16K
Smallest35.9 GB
LL
Lt Llama 2 7b instruct hf Q6 K
Llama · kaukole
Params6.74B
Context4K
Smallest5.5 GB
LL
Wanda pruned Llama 2 7b 0.7
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
my codellama experience model
Llama · sujalgawas
Params6.74B
Context16K
Smallest4.1 GB
PY
PygWin 2x7B FP16
Pygwin · Kquant03
Params11.1B
Context4K
Smallest22.1 GB
VI
Vicuna 7b v1.5
Vicuna · Medhaja
Params6.74B
Context4K
Smallest7.2 GB
SA
SambaLingo Thai Chat
Sambalingo · nnch
Params6.95B
Context4K
Q4_K_M4.2 GB
DO
Vihangd Dopeyshearedplats 2.7b v1
Dopeyshearedplats · tensorblock
Params2.7B
Context4K
Smallest1.0 GB
LL
tap ft codellama merge Q4 K M
Llama · LDES777
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
EvolCodeLlama 7b
Llama · ani-kavle
Params6.74B
Context16K
Smallest4.8 GB
LL
LLaMA2 13B Tiefighter
Llama · Geonyon
Params13B
Context4K
Q4_K_M7.9 GB
VI
vicuna-13b-v1.5
Vicuna · justin-turner
Params13B
Context4K
Q4_K_M7.9 GB
QW
qwen1.5 llm
Qwen · TrinhChou1102
Params2.77B
Context4K
Smallest5.6 GB