GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlfoundations dev oh v1.3 unnatural instructions x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Crystalcareai Meta Llama 3.1 8b Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · llm-finetune
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev llama3 1 8b oh v3.1 wo metamath 40k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FR
FractalSoup L3 8b
Fractalsoup · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
DongfuJiang prm version3 subsample hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · DuoNeural
Params8.03B
Context128K
Smallest3.3 GB
Tool use
BA
BanglaLLama 3.1 8b bangla alpaca orca instruct v0.0.1
Banglallama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh dcft v3 sharegpt format sedrick
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
L3.1 Moe 4x8B v0.2 i1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
HARC Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BE
Bella Bartender v2 Moody 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Jbliterated v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Pre Trained Mixed Korean Articles
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 70B PlumChat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 70B Instruct Jbliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Tulu 3 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange quantumcomputing
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 70b Cpt Sea Lionv3 Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Nemotron 70B Reward HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama Ione 8B Roleplay v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AD
Adversary 8B v1.22
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · pansophic
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing