GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
HI
HiTZ GoLLIE 13B AsSafeTensors
Hitz · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
GA
Gajendra v0.1 i1
Gajendra · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
SL
SLIMER
Slimer · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
posicube Llama2 chat AYT 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7b Ukrainian
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA 2 7B 32K
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
telugu llama 7b instruct v0.1
Llama · mradermacher
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
XW
Xwin Math 7B V1.1
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Speechless Thoughts Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
SynthIQ
Synthiq · sethuiyer
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
OpenMath Llama 2 70b Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
Coding
FI
Finance Chat
Finance · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llemma_7B
Llemma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
PU
PubMedLLaMa
Pubmedllama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SP
Spicyboros 13b 2.2
Spicyboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SambaLingo Arabic Base 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
XU
XuanYuan 13B Chat
Xuanyuan · RichardErkhov
Params13.1B
Context8K
Q4_K_M7.9 GB
GGUF
LL
StellarBright
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
kaori 34b v4
Kaori · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ORCA LLaMA 70B QLoRA
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GR
GREEN RadLlama2 7b
Green · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Dr Samantha 7b
Samantha · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
sanghwa-na/llama2-13b.kor.v2
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
LLaMA Pro 8B
Llama · mradermacher
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
ST
stairolz 70b i1
Stairolz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
SauerkrautLM 7B v1
Sauerkrautlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
sambanovasystems.SambaLingo Hungarian Base
Sambalingo · DevQuasar
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LL
KoboldAI LLaMA2 13B Erebus v3
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TA
Tat Llm 7b Fft
Tat · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing