GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
leolm_leo-hessianai-7b-chat-bilingual
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
KI
MythoMax Kimiko Mix
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AL
totally-not-an-llm_alpacacielo2-7b-8k
Alpacacielo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QR
Qra 13B chat
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AG
agentlm 13B
Agentlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardMath 7B V1.0
Wizardmath · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
RoLlama2 7b Base
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 7B Arguments
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
wizardlm_wizardmath-70b-v1.0
Wizardmath · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
DO
Dolphin 2.2 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SW
Swallow-13b-instruct-v0.1
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SU
Superswallow 7b v0.1
Superswallow · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WinterGoddess 1.4x limarpv3 70B L2 32k Requant
Wintergoddess · NexesQuants
Params69B
Context32K
Smallest14.5 GB
GGUF
LL
Llama 2 34b Uncode
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
bangla-llama-7b-instruct-v0.1
Llama · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
RE
ReluLLaMA 70B PowerInfer
Relullama · Tiiny
Params70B
Context—
Smallest42.2 GB
GGUF
PY
pygmalion 2 13b
Pygmalion · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
Sydney Overthinker 13B
Sydney · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 70B
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
OP
OpenHathi 7B Hi v0.1 Base
Openhathi · sarvamai
Params6.87B
Context4K
Smallest3.9 GB
GGUF
MY
MythoMakiseMerged 13B
Mythomakisemerged · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LA
latxa-13b-v1.2
Latxa · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XW
Xwin LM 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing