GGUF models: llama2 license
2213 GGUF models listed under the llama2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 41M to 240B parameters. The longest trained context is 128K tokens.
LL
Llama 2 13b chat norwegian Q4 K M
Llama · bettinadbarros
Params13B
Context4K
Q4_K_M7.9 GB
KA
karam 7b ing
Karam · Karam142
Params6.74B
Context4K
Smallest13.5 GB
PY
PygWin 4x7B FP16
Pygwin · Kquant03
Params19.7B
Context4K
Smallest39.5 GB
VE
Venus-103b-v1.0
Venus · mradermacher
Params103B
Context4K
Smallest21.7 GB
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Smallest3.3 GB
KO
Komodo 7b Base
Komodo · hollow-words
Params6.76B
Context4K
Q4_K_M4.1 GB
LL
Llama 2 7b Ukrainian q4
Llama · lohopusik
Params6.74B
Context4K
Smallest3.8 GB
VI
Vicuna 13b v1.5
Vicuna · Jai-V
Params13B
Context4K
Smallest10.5 GB
LL
llama fine tune
Llama · Jai-V
Params13B
Context4K
Smallest10.5 GB
SP
SpecEE 7b chat hf
Specee · YYDH2333
Params7.11B
Context4K
Smallest14.2 GB
LL
Llama 7B FineTune ArticleGen
Llama · NolanChai
Params6.74B
Context4K
Smallest7.2 GB
AI
Airavata
Airavata · therandomuser03
Params6.87B
Context4K
Q4_K_M4.2 GB
LL
LLaMAntino 2 7b GGUF 1.0
Llama · donnyweb
Params6.74B
Context4K
Q4_K_M4.1 GB
EV
EvolCodeLlama 7b Q4 K M
Evolcodellama · ani-kavle
Params6.74B
Context16K
Q4_K_M4.1 GB
VI
Vicuna 13b v1.5
Vicuna · pavitsu
Params13B
Context4K
Smallest13.8 GB
LL
llama2 ft career bot
Llama · somtirthadas2004
Params6.74B
Context4K
Smallest7.2 GB
AI
Airoboros L2 7b 2.2.1
Airoboros · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 2 7b chat hf
Llama · jeffmcc
Params6.74B
Context4K
Q4_K_M4.1 GB
MS
msy127 ft 240201 01
Msy · RichardErkhov
Params6.86B
Context2K
Q4_K_M4.2 GB
ME
Meditron 7b
Meditron · np-n
Params6.74B
Context2K
Smallest5.5 GB
RA
rank vicuna 7b v1 q4 0
Rank · castorini
Params6.74B
Context4K
Smallest3.8 GB
BE
BenchmaxxxerPS v1 123b
Benchmaxxxerps · mradermacher
Params124B
Context4K
Smallest45.7 GB
GE
Gembo v1.1 70b i1
Gembo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
HA
happymaker
Happymaker · morioxd
Params13B
Context4K
Smallest13.8 GB
LL
Llama 2 7B Chat
Llama · OllmOne
Params6.74B
Context4K
Q4_K_M4.1 GB
RE
ReluLLaMA 7B Q5 K M
Relullama · tt144
Params6.74B
Context2K
Smallest4.8 GB
LL
Llama 2 Ko DPO 13B
Llama · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
CH
ChuckMcSneed PMaxxxer v1 70b
Chuckmcsneed · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
BI
BigWeave v6 90b
Bigweave · RichardErkhov
Params87.8B
Context4K
Q4_K_M52.6 GB
CH
ChuckMcSneed Gembo v1.1 70b
Chuckmcsneed · RichardErkhov
Params69B
Context4K
Smallest25.5 GB