GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
SA
SambaLingo Arabic Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
LL
Codellama 7b Hf SFT GSM8k
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
SA
Samantha 1.11 70b
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AI
Airoboros C34B 2.1
Airoboros · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GA
Gaja v2.00
Gaja · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
LL
CodeLlama 34b Instruct Hf Abliterated
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
LlaMAndement 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
CO
coma 7B v0.1
Coma · DevQuasar
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama 34B Instruct Fp16
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
llama 2 chat 13b
Llama · qnixsynapse
Params13B
Context4K
Q4_K_M7.9 GB
GO
GoLLIE 7B safetensors
Gollie · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
BI
BigAurelian v0.5 120b 32k
Bigaurelian · mradermacher
Params118B
Context4K
Smallest43.6 GB
SA
SambaLingo Bulgarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
LM
LMCocktail 10.7B v1
Lmcocktail · andrijdavid
Params10.7B
Context4K
Q4_K_M6.5 GB
FI
W finetune
Finetune · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CH
CharGen v1 l2 13b
Chargen · kubernetes-bad
Params13B
Context4K
Smallest7.4 GB
LL
base burmese llm
Llama · 5w4n
Params6.87B
Context4K
Q4_K_M4.2 GB
LL
llama2 70b longlora fp16 32k ROPE8 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
QR
Qra 7b i1
Qra · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
OpenMath CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
PM
PMaxxxer v1 70b i1
Pmaxxxer · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DR
DrugAssist 7B
Drugassist · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
TA
Tat Llm 13b Fft
Tat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PR
ProTrix
Protrix · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
TO
tora 7B v1.0
Tora · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
PU
PULI LlumiX 32K
Puli · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
MI
Mistral 7b v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Charlie911 MultiLora temporal sharegpt
Charlie · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
SY
migtissera_synthia-7b-v1.2
Synthia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
sheep duck llama 2 70b v1.1 i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB