GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
XW
XwinCoder 13B i1
Xwincoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
CH
Charlie911 MultiLora drop sharegpt
Charlie · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Hungarian Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
SA
SambaLingo Hungarian Chat
Sambalingo · ariel-ml
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
SA
SambaLingo Bulgarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
ME
Medinote 7b
Medinote · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Changgil K2S3 Llama2 13b v1.0
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
RE
ReluLLaMA 13B
Relullama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vinallama 2.7b
Vinallama · mradermacher
Params2.77B
Context4K
Q4_K_M1.7 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · professorf
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LW
LWM Text Chat 128K iMat
Lwm · dranger003
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
LL
NoFo codellama 34b v0.1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · wilson989
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
OP
openthaigpt 1.0.0 13b chat
Openthaigpt · openthaigpt
Params13.1B
Context4K
Smallest26.2 GB
GGUF
LL
prosparse llama 2 7b
Llama · Tiiny
Params7B
Context—
Smallest14.5 GB
CodingEmbedding
LL
ELYZA japanese Llama 2 fast MoE 2x7B v0.1
Llama · mradermacher
Params11.2B
Context4K
Q4_K_M6.8 GB
GGUF
LL
ruadapt llama2 7b v0.1
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
DO
Dolphin 2.1 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PI
pie hq selfplay 7b
Pie · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
Dolphin Llama2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
Airoboros L2 70b 2.2.1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 13b hf rust finetune full
Llama · alphahg
Params13B
Context16K
Q4_K_M7.9 GB
Coding
TA
Tat Llm 70b Fft
Tat · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
uukuguy/speechless-thoughts-mistral-7b-v1.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama 2 7b monika v0.3b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XW
Xwin Math 70B V1.0
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
KoboldAI LLaMA2 13B Psyfighter2
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DO
DolphinHermes 120b i1
Dolphinhermes · mradermacher
Params120B
Context4K
Smallest25.6 GB
Tool use
SA
Samantha 1.11 13b
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing