GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ML
mlfoundations dev oh v1.3 unnatural instructions x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Crystalcareai Meta Llama 3.1 8b Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · llm-finetune
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo metamath 40k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FR
FractalSoup L3 8b
Fractalsoup · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm version3 subsample hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · DuoNeural
Params8.03B
Context128K
Smallest3.3 GB
BA
BanglaLLama 3.1 8b bangla alpaca orca instruct v0.0.1
Banglallama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v3 sharegpt format sedrick
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
L3.1 Moe 4x8B v0.2 i1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HARC Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Bella Bartender v2 Moody 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Jbliterated v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pre Trained Mixed Korean Articles
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70B PlumChat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B Instruct Jbliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange quantumcomputing
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70b Cpt Sea Lionv3 Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Nemotron 70B Reward HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Ione 8B Roleplay v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AD
Adversary 8B v1.22
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · pansophic
Params8.03B
Context128K
Q4_K_M4.9 GB