GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Midnight Rose 103b v1.0
Midnight · mradermacher
Params103B
Context4K
Smallest21.7 GB
GGUF
MI
Midnight Rose 70B v2.0.3 i1
Midnight · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Llama2 22B GPLATTY
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
GA
Gaja vv1
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
AI
Airoboros L2 70b 2.1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CO
CodeRosa 70B AB1
Coderosa · altomek
Params69B
Context4K
Smallest14.5 GB
Coding
DO
DoubleGold v0.5 123b 32k i1
Doublegold · mradermacher
Params124B
Context32K
Smallest26.3 GB
GGUF
LL
Llammas Base
Llammas · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
opus v0.5 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llava 1.5 13b Hf
LLaVA · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Vision
AI
Airoboros C34B 3.1.2
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
MI
Karen TheEditor V2 STRICT Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
strix rufipes 70b i1
Strix · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CH
Chronos Beluga v2 13B
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 70b Instruct hf
Llama · LoneStriker
Params69B
Context2K
Q4_K_M41.4 GB
Coding
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
mlfoundations dev llama2 oh teknium scaling down random 0.8
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SauerkrautLM 70B v1
Sauerkrautlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
speechless mistral dolphin orca platypus samantha 7b dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 34b Instruct Hf Abliterated
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
CH
ChocoLlama 2 7B Base
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama2 13B Eugeneparkthebest
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
XW
Xwin Math 70B V1.0
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MA
Magicoder S CL 7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
ORCA LLaMA 70B QLoRA i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin longLORA 70b rope8 32k fp16 i1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SP
SparseLLM ReluLLaMA 13B
Sparsellm · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Taiwan LLaMa v1.0
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
Opencsg Stable Code 3b v1
Opencsg · RichardErkhov
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
ValiantLabs Llama2 13B ShiningValiant
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing