GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GO
GOAT 70B Storytelling
Goat · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AR
ArcaneEntanglement model64 70b i1
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 13B SuperCOT2
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMA2 13B Psyfighter2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMAntino 2 7b Hf ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Story Reverse Prompt 70b Rope8 32K Fp16
Story · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YO
Youri 7b Instruction
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
FI
finance chat
Finance · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MO
model 007 70B
Model · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AU
Augmental 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
InverseCoder-CL-7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
llama polyglot 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
MoMo 70B V1.1 i1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
WI
WizardMath 70B V1.0
Wizardmath · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
ST
storytime 13B
Storytime · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TA
TableLLM 7b
Tablellm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
CodingReasoning
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LE
leolm_leo-hessianai-7b
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
open-orca_llongorca-7b-16k
Llongorca · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
NE
nexusflow_nexusraven-13b
Nexusraven · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
WI
WizardCoder Python 34B V1.0
Wizardcoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
SA
Sarah StoryTeller 13b
Sarah · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PS
Psyfighter 13B
Psyfighter · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing