GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
open-orca_llongorca-13b-16k
Llongorca · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
MY
L2 MythoMax22b Instruct Falseblock
Mythomax · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
LL
code Llama 2 13B
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
emma 500 llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · mradermacher
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
LL
flozi00_llama-2-13b-german-assistant-v2
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
fpham_karen_theeditor_v2_creative_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XW
Xwin LM 7B V0.1
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Vinallama 7b Chat
Vinallama · RichardErkhov
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
LL
ShiningValiantXS
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Samantha 1.11 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1.2
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DO
dolphin 2.2 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CO
coma-7B-v0.1
Coma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KI
Rose Kimiko 20B
Kimi · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
EU
Euryale 1.3 longLORA 70b rope8 32k fp16
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama2 Chat AYT 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KI
KitchenSink 103b i1
Kitchensink · mradermacher
Params103B
Context4K
Smallest22.0 GB
Roleplay
QR
Qra 7b Dolly Instruction 0.1
Qra · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow 13B Instruct
Swallow · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-70b
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7b chat norwegian i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing