GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron lorablated 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 w v3 camel biology gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch3 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
neuralmagic.Sparse Llama 3.1 8B Ultrachat_200K 2of4
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Distill Llama UK Legislation 8B
DeepSeek · EryriLabs
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
THUDM/LongWriter-llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Techne RP 8b v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
EG
Egregore Alice RP NSFW 4B
Egregore · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
Roleplay
LL
Llama 3.1 Tulu 3 8B DPO
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B VaaniSetu EN2PA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
AS
AstroSage 70B 20251009
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ML
mlfoundations dev oh v1 2 only airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev stackoverflow 10000tasks .25p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange scicomp i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
shisa-v2-llama3.1-405b
Llama · DevQuasar
Params406B
Context128K
Q4_K_M243.1 GB
Tool use
LL
Llama 3.1 Swallow 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev evol tt 5s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch4 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3.5 70B R
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange puzzling
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Nephilim Metamorphosis v1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo camel math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B PlumChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DC
oh dcft v3.1 gemini 1.5 pro
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b webinstruct original 750k uniform
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing