GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Test_Llama
Llama · DreamTree
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Pramodaic
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DI
Distilled DarkPlanet Allades 8B
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Stormeder v1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · polyverse
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · 5fp
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Sriexe
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · okamototk
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q2 K
Llama · roleplaiapp
Params70.6B
Context128K
Smallest26.4 GB
CodingRoleplayTool use
LL
Meta Llama 3.1 8B Instruct
Llama · kolosal
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
PULI LlumiX Llama 3.1
Llama · rewqt435
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · viniciusianni
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · xyottax
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ML
mlfoundations dev oh v1.3 metamath x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · annus-lums
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Chat Companion
Llama · DarkLegion
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · reach-vb
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
MFANN llama3.1 abliterated SLERP v3.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Viper Llama31 8b
Llama · mx003
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Ffftdtd5dtft
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · polyverse
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · shisahni
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · AmpereComputing
Params8.03B
Context128K
Smallest8.1 GB
Tool use

Keep browsing