GGUF models: llama2 license

2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 13b chat norwegian Q4 K M
Llama · bettinadbarros
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KA
karam 7b ing
Karam · Karam142
Params6.74B
Context4K
Smallest13.5 GB
GGUF
PY
PygWin 4x7B FP16
Pygwin · Kquant03
Params19.7B
Context4K
Smallest39.5 GB
GGUF
VE
Venus-103b-v1.0
Venus · mradermacher
Params103B
Context4K
Smallest21.7 GB
GGUF
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Smallest3.3 GB
GGUF
KO
Komodo 7b Base
Komodo · hollow-words
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b Ukrainian q4
Llama · lohopusik
Params6.74B
Context4K
Smallest3.8 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · Jai-V
Params13B
Context4K
Smallest10.5 GB
GGUF
LL
llama fine tune
Llama · Jai-V
Params13B
Context4K
Smallest10.5 GB
GGUF
SP
SpecEE 7b chat hf
Specee · YYDH2333
Params7.11B
Context4K
Smallest14.2 GB
GGUF
LL
Llama 7B FineTune ArticleGen
Llama · NolanChai
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AI
Airavata
Airavata · therandomuser03
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
LLaMAntino 2 7b GGUF 1.0
Llama · donnyweb
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EV
EvolCodeLlama 7b Q4 K M
Evolcodellama · ani-kavle
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
VI
Vicuna 13b v1.5
Vicuna · pavitsu
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
llama2 ft career bot
Llama · somtirthadas2004
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AI
Airoboros L2 7b 2.2.1
Airoboros · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 2 7b chat hf
Llama · jeffmcc
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MS
msy127 ft 240201 01
Msy · RichardErkhov
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Smallest5.5 GB
GGUF
RA
rank vicuna 7b v1 q4 0
Rank · castorini
Params6.74B
Context4K
Smallest3.8 GB
GGUF
BE
BenchmaxxxerPS v1 123b
Benchmaxxxerps · mradermacher
Params124B
Context4K
Smallest45.7 GB
GGUF
GE
Gembo v1.1 70b i1
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HA
happymaker
Happymaker · morioxd
Params13B
Context4K
Smallest13.8 GB
GGUF
LL
Llama 2 7B Chat
Llama · OllmOne
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RE
ReluLLaMA 7B Q5 K M
Relullama · tt144
Params6.74B
Context2K
Smallest4.8 GB
GGUF
LL
Llama 2 Ko DPO 13B
Llama · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CH
ChuckMcSneed PMaxxxer v1 70b
Chuckmcsneed · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
BI
BigWeave v6 90b
Bigweave · RichardErkhov
Params87.8B
Context4K
Q4_K_M52.6 GB
GGUF
CH
ChuckMcSneed Gembo v1.1 70b
Chuckmcsneed · RichardErkhov
Params69B
Context4K
Smallest25.5 GB
GGUF

Keep browsing