GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StableBeluga 7B
Stablebeluga · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SN
Snakmodel 7b Instruct
Snakmodel · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DU
dulia 13b 8k alpha
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
XW
Xwin LM 7B V0.2
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Hungarian Base 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
persona generator llama 2 7b qlora merged i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WinterGoddess 1.4x 70b 32k
Wintergoddess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7b Hf
Llama · DevQuasar-8
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llemma 34b
Llemma · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
Reasoning
CA
Canarim 7b
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
SambaLingo Russian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
WE
webbigdata ALMA 7B Ja V2
Webbigdata · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Codellama 7b Hf SFT Warmup GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MY
MysticFusion 13B i1
Mysticfusion · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
Canarim 7b
Canarim · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
airoboros l2 13b 2.1 i1
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
Meditron 70b
Meditron · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LE
LeetCodeWizard 7B V1.1
Leetcodewizard · Nan-Do
Params6.74B
Context16K
Smallest3.3 GB
Coding
DU
duliadotio dulia 13b 8k alpha
Duliadotio · RichardErkhov
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
AR
arcane 7b
Arcane · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Samantha 1.1 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HU
Huginn v3 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
jarradh_llama2_70b_chat_uncensored
Llama · DonnyFlo85
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
ME
MegaMix T1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llava v1.5 7b gpt4OCR hf GGUF Q4 K M
LLaVA · nnethercott
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
LL
OpenMath CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
Coding
GO
goliath 120b
Goliath · TheBloke
Params118B
Context4K
Smallest49.6 GB
GGUF
PR
ProTrix
Protrix · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
Covasna 0.1
Covasna · mradermacher
Params41.6B
Context32K
Q4_K_M25.3 GB
GGUF
SM
SMaxxxer v1 70b i1
Smaxxxer · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing