GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b Chat Hf
Llama · sibikarthik
Params6.74B
Context4K
Smallest3.8 GB
GGUF
VI
Vicuna 7b v1.5 16k
Vicuna · PiterOfc
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llamat 2 Chat
Llama · WilhelmBuitrago
Params6.74B
Context2K
Smallest5.5 GB
GGUF
LL
Llama 2 7b Hf
Llama · atahmih
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BI
BigWeave v12 90b
Bigweave · RichardErkhov
Params87.8B
Context4K
Q4_K_M52.6 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · morrissas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DO
DoxyLLamaLong
Doxyllamalong · LukasSonn
Params33.7B
Context16K
Smallest35.9 GB
GGUF
AU
Augmental-ReMM-13b-Merged
Augmental · Ransss
Params13B
Context4K
Smallest10.7 GB
GGUF
LL
llama2 13b.kor.v2
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
NO
BasicEconomics SpicyBoros 2.2 7B QLORA v0.2
Nomic · adamo1139
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 7b
Llama · qnixsynapse
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
MasterRP V1 L2 13B
Masterrp · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
MI
Karen TheEditor V2 STRICT Mistral 7B Q5 K S
Mistral · Clevyby
Params7.24B
Context32K
Smallest5.0 GB
GGUF
BA
BanglaLLama 3 8b BnWiki Base
Banglallama · BanglaLLM
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mistral fine tune
Mistral · Jai-V
Params13B
Context4K
Smallest10.5 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · Fabio2000
Params6.74B
Context4K
Smallest7.2 GB
GGUF
TO
ToRoLaMa 7b v1.0
Torolama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
VI
Vicuna 7B v1.5
Vicuna · ItsPeet
Params6.74B
Context4K
Smallest3.3 GB
GGUF
LL
Llama 2 13b Chat Hf
Llama · JBritt
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
shearedplats 2.7b v1
Shearedplats · tensorblock
Params2.7B
Context4K
Smallest1.0 GB
GGUF
GR
GREEN-RadLlama2-7b
Green · Synec801
Params6.74B
Context4K
Smallest7.2 GB
GGUF
SA
SambaLingo Turkish Chat
Sambalingo · Jobaar
Params6.95B
Context4K
Smallest4.9 GB
GGUF
LL
Lawyer Llama 13b v2
Llama · ooff123
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
QR
Qra gguf PL
Qra · sieciowe
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b chat hf SW2 test fine tuned cpu
Llama · lltutor
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RE
ReluLLaMA 7B Q8 0
Relullama · tt144
Params6.74B
Context2K
Smallest7.2 GB
GGUF
VE
Venus-120b-v1.0
Venus · mradermacher
Params120B
Context4K
Smallest44.2 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · lamptablet
Params7.24B
Context32K
Smallest5.9 GB
GGUF
LA
HiTZ Latxa 7b v1.1
Latxa · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
TR
Trurl 2 7B Q4 K M
Trurl · Wojtekb30
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing