GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
Barcenas 13b
Barcenas · Danielbrdz
Params13B
Context2K
Q4_K_M8.1 GB
GGUF
EU
Euryale 1.4 L2 70B IQ2
Euryale · Kooten
Params69B
Context4K
Smallest18.3 GB
GGUF
LL
Llama2 13b Dpo v7
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · matrixportalx
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 30 percent compression Q4 K M
Llama · PruningEverything
Params4.71B
Context4K
Q4_K_M4.2 GB
GGUF
LL
ELYZA Japanese Llama 2 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SA
Sambanovasystems SambaLingo Arabic Base 70B
Sambalingo · tensorblock
Params69.4B
Context4K
Smallest25.7 GB
GGUF
LL
Lt Llama 2 13b instruct hf Q4 0
Llama · Cheatmeal
Params13B
Context4K
Smallest7.4 GB
GGUF
PI
pie hq selfplay 7b
Pie · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GGUF
VI
Vicuna Class Shishya Ac Hal 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
BA
Danielbrdz Barcenas 3b
Barcenas · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
GGUF
OP
OpenHathi 7B Hi v0.1 Base
Openhathi · jayshah5696
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 13b Chat Hf
Llama · Liuzzyy
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
SynthIA 70B v1.5
Synthia · migtissera
Params69B
Context2K
Smallest38.9 GB
GGUF
LL
meditron-7b
Llama · chrohi
Params6.74B
Context2K
Smallest7.2 GB
GGUF
VE
Venus-103b-v1.0
Venus · mradermacher
Params103B
Context4K
Smallest37.9 GB
GGUF
LL
Kaeri Jenti Llama 2 Koen 13b v1.3
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
ME
Meditron 7b
Meditron · davidbzyk
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
l2 7b sayori ddlc v0.1
Sayori · 922-CA
Params6.74B
Context2K
Smallest5.1 GB
GGUF
LL
Daekeun Ml Llama 2 Ko OpenOrca Gugugo 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CH
chattychatchat-13b-l2-fp16
Chattychatchat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama models
Llama · Ywung
Params6.74B
Context—
Smallest3.8 GB
GGUF
HY
HyperLlama2Test
Hyperllama · HyperdustProtocol
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PY
Pygmalion 2 7b
Pygmalion · JK1116
Params6.74B
Context4K
Smallest3.9 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PY
Pygmalion 2 13b
Pygmalion · Lucy-in-the-Sky
Params13B
Context4K
Smallest4.9 GB
GGUF
VI
Vicuna Class Tutor 7b Ep3
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
AI
airoboros c34b 2.2.1
Airoboros · Nexesenex
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
SH
ShareGPT4V 7B
Sharegpt · nakodanei
Params6.74B
Context4K
Smallest4.8 GB
Vision

Keep browsing