GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
KO
Komodo 7b Base
Komodo · IBPME
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama2 7b langchain chat
Llama · hfgdfdsd
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
llama 2
Llama · modularai
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CH
ChuckMcSneed SMaxxxer v1 70b
Chuckmcsneed · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
TheBloke CodeLlama 34B Instruct Fp16
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
OP
OpenHathi 7B Hi v0.1 Base
Openhathi · QuantFactory
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
CO
Code Millenials 13b
Code · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SA
saiga2 7b
Saiga · DFofanov78
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
codellama_codellama-7b-instruct-hf
Llama · OllmOne
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
BI
BigWeave v7.1 124b
Bigweave · mradermacher
Params124B
Context4K
Smallest45.4 GB
GGUF
VI
Vinallama 7b
Vinallama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
AU
Augmental Shuffled Merged
Augmental · Heralax
Params13B
Context4K
Smallest9.2 GB
GGUF
YO
Rinna Youri 7b Instruction
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BO
boolean search model
Boolean · Zwounds
Params8.03B
Context128K
Smallest16.1 GB
Tool use
SA
safespace 7b
Samantha · danlou
Params6.74B
Context4K
Smallest3.8 GB
GGUF
XW
Xwin LM 70B V0.1_Jannie
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 70B V0.1_Jannie
Xwin · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
TO
tokyotech llm Swallow 7b plus hf
Tokyotech · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VE
Venus-103b-v1.2
Venus · mradermacher
Params103B
Context4K
Smallest21.7 GB
GGUF
LL
LLama3-Gaja-Hindi-8B-v0.1
Llama · hus960
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 ko 7B
Llama · 24bean
Params6.86B
Context2K
Smallest7.3 GB
GGUF
NE
Uukuguy Neural Chat 7b v3 1 Dare 0.85
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
RO
Rose 20B
Rose · mradermacher
Params20B
Context4K
Smallest40.0 GB
GGUF
MU
MultiLora drop sharegpt
Multilora · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LA
HiTZ Latxa 7b v1.2
Latxa · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
llama3 openhermes 2.5
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
OB
ObjLLama 7b Hf
Objllama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AL
ALMA 7B Ja V2 i1
Alma · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing