GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
XW
XwinCoder 13B i1
Xwincoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CH
Charlie911 MultiLora drop sharegpt
Charlie · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
SA
SambaLingo Hungarian Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
SA
SambaLingo Hungarian Chat
Sambalingo · ariel-ml
Params6.95B
Context4K
Q4_K_M4.2 GB
SA
SambaLingo Bulgarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
ME
Medinote 7b
Medinote · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Changgil K2S3 Llama2 13b v1.0
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
RE
ReluLLaMA 13B
Relullama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vinallama 2.7b
Vinallama · mradermacher
Params2.77B
Context4K
Q4_K_M1.7 GB
LL
CodeLlama 7b Instruct Hf
Llama · professorf
Params6.74B
Context16K
Q4_K_M4.1 GB
LW
LWM Text Chat 128K iMat
Lwm · dranger003
Params6.74B
Context128K
Q4_K_M4.1 GB
LL
NoFo codellama 34b v0.1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · wilson989
Params33.7B
Context16K
Q4_K_M20.2 GB
OP
openthaigpt 1.0.0 13b chat
Openthaigpt · openthaigpt
Params13.1B
Context4K
Smallest26.2 GB
LL
prosparse llama 2 7b
Llama · Tiiny
Params7B
Context—
Smallest14.5 GB
LL
ELYZA japanese Llama 2 fast MoE 2x7B v0.1
Llama · mradermacher
Params11.2B
Context4K
Q4_K_M6.8 GB
LL
ruadapt llama2 7b v0.1
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
DO
Dolphin 2.1 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PI
pie hq selfplay 7b
Pie · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Dolphin Llama2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
Airoboros L2 70b 2.2.1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
CodeLlama 13b hf rust finetune full
Llama · alphahg
Params13B
Context16K
Q4_K_M7.9 GB
TA
Tat Llm 70b Fft
Tat · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
uukuguy/speechless-thoughts-mistral-7b-v1.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 2 7b monika v0.3b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
XW
Xwin Math 70B V1.0
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
KoboldAI LLaMA2 13B Psyfighter2
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
DO
DolphinHermes 120b i1
Dolphinhermes · mradermacher
Params120B
Context4K
Smallest25.6 GB
SA
Samantha 1.11 13b
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB