GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Dr Samantha 7b
Samantha · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
TA
Tamima 7b Base v0.1
Tamima · mradermacher
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
QR
Qra 1b Dolly Instruction 0.1
Qra · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Moondriller Llama2 13B Eugeneparkthebest
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
GGUF
LL
haryra 7b llama2 id
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Medical Llama2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMAntino 2 Chat 13b Hf UltraChat ITA
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
kykim0 codellama 7b ultrachat
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
XW
Xwin Math 7B V1.0
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AR
Arcane 13b
Arcane · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VE
Venus 103b v1.1
Venus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
LL
Abacusai Llama 3 Smaug 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
XW
Xwin Math 7B V1.1
Xwin · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MO
monika l2 7b v0.9a
Monika · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
MoP_llava_1.5_40_percent_compression_2_epochs
LLaVA · c2d-usp
Params3.86B
Context4K
Q4_K_M3.4 GB
Vision
PY
Pygmalion 2 7b
Pygmalion · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
meditron 7b dpo full sft wo kqa golden
Meditron · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
RE
ReMantik-L2-70B
Remantik · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CH
chinese alpaca 2 13b
Chinese · sdasd112132
Params13.3B
Context4K
Smallest7.5 GB
GGUF
OP
OpenCodeInterpreter CL 70B iMat
Opencodeinterpreter · dranger003
Params69B
Context16K
Smallest18.3 GB
GGUF
SA
SambaLingo Slovenian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
AI
Airoboros L2 7b 2.1
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Smallstepai Misal 7B Instruct v0.1
Misal · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
RE
ReluLLaMA 13B PowerInfer
Relullama · Tiiny
Params13B
Context—
Smallest28.3 GB
GGUF
SA
SambaLingo Hungarian Base 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
LL
Ballistic CodeLlama 34B v1
Llama · BallisticAI
Params33.7B
Context16K
Smallest35.9 GB
Coding
MI
Uukuguy Speechless Code Mistral Orca 7b v1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
ES
EstopianMaid 13B
Estopianmaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
XW
XwinCoder 34B
Xwincoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Keep browsing