GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Nemotron lorablated 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 camel biology gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch3 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
neuralmagic.Sparse Llama 3.1 8B Ultrachat_200K 2of4
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama UK Legislation 8B
DeepSeek · EryriLabs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
THUDM/LongWriter-llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Techne RP 8b v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EG
Egregore Alice RP NSFW 4B
Egregore · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama 3.1 Tulu 3 8B DPO
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B VaaniSetu EN2PA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
AstroSage 70B 20251009
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1 2 only airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 10000tasks .25p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 8b mlfoundations dev stackexchange scicomp i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
shisa-v2-llama3.1-405b
Llama · DevQuasar
Params406B
Context128K
Q4_K_M243.1 GB
LL
Llama 3.1 Swallow 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev evol tt 5s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch4 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 70B R
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange puzzling
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Nephilim Metamorphosis v1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo camel math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 gemini 1.5 pro
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b webinstruct original 750k uniform
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB