GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 EstLLM 8B 0525
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NA
NarrowMaid 8B
Narrowmaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
nvidia.OpenMath2 Llama3.1 70B
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Supernova Lite Instruct Merge Abliterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
teknium/Llama-3.1-AlternateTokenizer
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · hakks660
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Orenguteng Llama 3.1 8B Lexi Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
deepthought 8b llama v0.01 alpha
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TO
ToM PBM 8B
Tom · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Amelia ET 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MU
Multiclass Think RM 8B
Multiclass · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Eurdem/Defne-llama3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 MedIT SUN 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
SAO LightMix 8B Model Stock i1
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
Test_3AD80
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DC
oh dcft v1.3 no curation gpt 4o mini scale 8x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Nephilim Metamorphosis v1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct DASHQ Q2
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
Tool use
LL
Llama PLLuM 8B Instruct 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 w v3 camel chemistry gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta 405b instruct cpu optimized
Llama · nisten
Params410B
Context128K
Smallest169.0 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama3.1 8B Fireplace2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EV
EvoNet 8b Reasoning
Evonet · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning

Keep browsing