GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WizardCoder Python 13B V1.0 i1
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AR
ARIA 70B V2
Aria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
LosslessMegaCoder Llama2 7B Mini
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
TO
tokyotech llm Swallow 13b instruct v0.1
Tokyotech · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow-7b-instruct-v0.1
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
AU
Augmental 13B v1.50 B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
FashionGPT 70B V1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PA
pipizhao_pandalyst-7b-v1.1
Pandalyst · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AI
jondurbin_airoboros-c34b-2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
code Llama 2 13B i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
nousresearch_yarn-llama-2-7b-64k
Llama · TheBloke
Params6.74B
Context64K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
FA
FashionGPT 70B V1.2 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 70B Ensemble v5
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DU
dulia 13b 8k alpha i1
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 13B 2.2
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
Coding
MI
emrgnt-cmplxty_mistral-7b-phibrarian-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
COTHuginn 4.5 19B
Cothuginn · TheBloke
Params19.4B
Context4K
Q4_K_M11.7 GB
GGUF
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
VI
vicuna 13B v1.5
Vicuna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
migtissera_synthia-70b-v1.2
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1.1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
bofenghuang_vigogne-2-7b-instruct
Vigogne · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing