GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
XW
Xwin LM 13B V0.2 imatrix
Xwin · antiven0m
Params13B
Context4K
Smallest3.9 GB
GGUF
RE
ReluLLaMA 70B i1
Relullama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
SA
SambaLingo Turkish Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Telugu Llama2 7B v0 Instruct
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
Xwinter 120b
Xwinter · mradermacher
Params118B
Context4K
Smallest43.6 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CA
Cat 0.5
Cat · Heralax
Params13B
Context4K
Smallest9.2 GB
GGUF
XW
Xwin LM 13B V0.1
Xwin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Augmental ReMM 13b Merged
Augmental · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SL
SlimPLM Query Rewriting
Slimplm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Misal 7B Instruct v0.1
Misal · mradermacher
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
LL
llava v1.5 7b hf vicuna
LLaVA · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
WI
WizardLM 70B V1.0
Wizardlm · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HU
huginnv1.2
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Arabic Base
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
EU
Euryale 1.4 L2 70B i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
SW
Swallow 7b Instruct v0.1
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
TH
13B Theseus MK1
Theseus · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
FashionGPT 70B V1.1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MO
moneyforward houou instruction 7b v2
Moneyforward · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MO
motherduckdb DuckDB NSQL 7B v0.1
Motherduckdb · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
bangla llama 13b base v0.1
Llama · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
LL
CodeLlama 13b Instruct Hf Abliterated
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
OpenMath Llama 2 70b Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
Coding
LL
Emma 500 Llama2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Samantha 1.11 7b
Samantha · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Radiantloom Llama 70b Instruct
Llama · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
SE
sethuiyer SynthIQ 7b
Sethuiyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
tamil llama 7b instruct v0.2
Llama · abhinand
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Thai Base 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF

Keep browsing