GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
SambaLingo Arabic Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Codellama 7b Hf SFT GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
Samantha 1.11 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Airoboros C34B 2.1
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
GA
Gaja v2.00
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
CodeLlama 34b Instruct Hf Abliterated
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
LlaMAndement 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CO
coma 7B v0.1
Coma · DevQuasar
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
CodeLlama 34B Instruct Fp16
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llama 2 chat 13b
Llama · qnixsynapse
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
GoLLIE 7B safetensors
Gollie · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
BI
BigAurelian v0.5 120b 32k
Bigaurelian · mradermacher
Params118B
Context4K
Smallest43.6 GB
GGUF
SA
SambaLingo Bulgarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
LM
LMCocktail 10.7B v1
Lmcocktail · andrijdavid
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FI
W finetune
Finetune · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CH
CharGen v1 l2 13b
Chargen · kubernetes-bad
Params13B
Context4K
Smallest7.4 GB
Roleplay
LL
base burmese llm
Llama · 5w4n
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
llama2 70b longlora fp16 32k ROPE8 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
QR
Qra 7b i1
Qra · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
OpenMath CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
PM
PMaxxxer v1 70b i1
Pmaxxxer · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DR
DrugAssist 7B
Drugassist · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TA
Tat Llm 13b Fft
Tat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PR
ProTrix
Protrix · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
tora 7B v1.0
Tora · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
PU
PULI LlumiX 32K
Puli · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7b v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Charlie911 MultiLora temporal sharegpt
Charlie · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SY
migtissera_synthia-7b-v1.2
Synthia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
sheep duck llama 2 70b v1.1 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing