GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Swallow 70B Instruct v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hercules 6.1 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PY
PyThagorean 10B
Pythagorean · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Coding
LL
Llama 3.1 8B Instruct NVFP4
Llama · prithivMLmods
Params8.03B
Context128K
Smallest6.0 GB
CodingTool use
LL
wraith 8b
Llama · vanta-research
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · wyattjo116
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ML
mlfoundations dev oh dcft v1.1 no curation
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ilsp.Llama Krikri 8B Base
Llama · DevQuasar-7
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
ML
mlfoundations dev oh v1.3 camel chemistry x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KokoroChat Low
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Megatron
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
DA
Dare_Angel_8B
Dare · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Middo Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 70B Instruct v0.3
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
VI
Vire Protocol 70b
Vire · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AN
L3.1 8B Animus V12.2
Animus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Middo Alpaca 4o Mini
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Mediver V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Gemma 2 27b CPO SimPO iter2 i1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
openthoughts3 10k llama3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Fusion 6040
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nvidia OpenMath2 Llama3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama SEA Guard 8B 2602
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
OpenMath2 Llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
irlab udc Llama 3.1 8B Instruct Galician
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Gemma 2 27b ORPO iter3
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · R4xx1
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use

Keep browsing