GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
shisa v2 llama3.1 405b
Llama · shisa-ai
Params406B
Context128K
Q4_K_M243.1 GB
Tool use
CE
CellHermes v1.0
Cellhermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
BL
Blaze 14B xElite
Blaze · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LL
Codette Llama 3.1 8b Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 Storm 8B
Llama · HoneyBadger2989
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
oh dcft v3.1 qwen 2.5 72b i1
Qwen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Leonida
Llama · jgchaparro
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 8B Instruct 2512
Llama · Jerzman
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DobHerHard R1 v1.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ML
mlfoundations dev stackoverflow 5000tasks .5p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
XX
xxx777xxxASD L3.1 ClaudeMaid 4x8B
Xxx · RichardErkhov
Params24.9B
Context128K
Q4_K_M15.2 GB
GGUF
NA
Naija Reviewer 8b v2
Naija · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Poro 2 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama3.1 MFANN 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · tripolskypetr
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
proxectonos/Llama-3.1-Carballo
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CL
Clarky
Clarky · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1 w v3 evol instruct
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Locutusque Apollo 2.0 Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 70B ShiningValiant2
Llama · DevQuasar-3
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
New Dawn Llama3.1 70b v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
shisa-v2-llama3.1-8b
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DC
oh dcft v1.3 no curation gpt 4o mini scale 2x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
BRAG Llama 3.1 8b v0.1
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Lugha Llama 8B Wura
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
ZEUS 8B V8 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CO
CounselingBotLlama3.18B
Counselingbotllama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing