GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
LL
spack llama 7b
Llama · daniellnichols
Params6.74B
Context16K
Smallest3.8 GB
LL
ELYZA Japanese Llama 2 13b Fast Instruct
Llama · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
LL
Llama 2 13b Hf
Llama · shoh99
Params13B
Context4K
Smallest13.8 GB
LL
CodeLlama 7b Python Hf
Llama · ysn-rfd
Params6.74B
Context16K
Smallest2.5 GB
AU
Aurora Nights 70B v1.0 GGUF 2bit
Aurora · Artefact2
Params69B
Context4K
Smallest18.3 GB
LL
meditron-7b
Llama · ccarrez
Params6.74B
Context2K
Q4_K_M4.1 GB
SE
SeewebLLM it Q2 K
Seewebllm · antoste
Params6.74B
Context4K
Smallest2.5 GB
MI
Uukuguy Mistral 7b Platypus Fp16 Dare 0.9
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ME
Megamix-A1-13B
Megamix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LM
Yhyu13/LMCocktail-10.7B-v1-function-calling
Lmcocktail · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
CodeLlama 13B TestGen Dart v0.2
Llama · jacobhoffmann
Params13B
Context16K
Smallest7.4 GB
RE
REMM PYG 0.65 SLERP
Remm · Brouz
Params13B
Context4K
Smallest9.2 GB
AU
Augmental 13b two epochs
Augmental · Heralax
Params13B
Context4K
Smallest9.2 GB
LL
Llama-2-13b-chat-hf
Llama · zhentaoyu
Params13B
Context4K
Smallest7.4 GB
EC
SnowyRP FinalV1 L2 13B
Echidna · Masterjp123
Params13B
Context4K
Smallest7.4 GB
PE
perky 103b v0.1
Perky · mradermacher
Params103B
Context4K
Smallest38.2 GB
LL
Llama 2 7b Chat Hf
Llama · teleprint-me
Params6.74B
Context4K
Smallest13.5 GB
WI
WizardLM 13B v1.2
Wizardlm · Sethblocks
Params13B
Context2K
Smallest7.3 GB
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · wolflycanorcant
Params13B
Context16K
Q4_K_M7.9 GB
TR
Trinity 13B
Trinity · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
NO
BasicEconomics SpicyBoros 2.2 7B QLORA v0.1
Nomic · adamo1139
Params6.74B
Context4K
Q4_K_M4.1 GB
YO
Rinna Youri 7b
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
CodeLlama 7b Instruct Hf
Llama · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
LL
Lt Llama 2 7b instruct hf Q4 K M
Llama · Cheatmeal
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 2 7b Hf
Llama · nil471
Params6.74B
Context4K
Smallest2.5 GB
WI
WizardCoder Python 34B V1.0 Q5 K M
Wizardcoder · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
SA
Sarah_StoryTeller_13b_HF
Sarah · FPHam
Params13B
Context4K
Smallest10.7 GB
GO
Goliath 120b
Goliath · mradermacher
Params118B
Context4K
Smallest43.2 GB
OP
openchat v3.2 Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama 2 13b Guanaco QLoRA
Llama · nitsuai
Params13B
Context2K
Q4_K_M7.9 GB