GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
KISTI-KONI/KONI-Llama3.1-70B-Instruct-20241115
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 70B Instruct
Llama · etemiz
Params70.6B
Context128K
Smallest15.3 GB
Tool use
LL
Llama 3.1 8b DodoWild v2.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
DevQuasar llama3.1 8b chat brainstorm v3.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b science sft
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DI
Distilled DarkPlanet Allades 8B TIES
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B EZO 1.1 it
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ML
mlfoundations dev OH DCFT V3 wo unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
MY
myalee v3 L31 8B
Myalee · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Filipino llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MA
magpielm 8b sft v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama OpenReviewer 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Hotep Llm Kush v82 Gguf Q4_K_M
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hastagaras/Llama-3.1-8B-Tortoise
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · LaniakeaPH
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 174 Shisav2.If50.Tltweak Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
cebuano llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama Sahabat AI v2 70B IT
Llama · komixenon
Params70.6B
Context128K
Smallest26.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mukel
Params8.03B
Context128K
Smallest4.5 GB
GGUF
DC
oh dcft v1.3 no curation gpt 4o mini scale 0.125x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
oh dcft v3.1 qwen 2.5 72b
Qwen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oh dcft v3.1 llama 3.1 405b v2dummytesting
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ChatParts Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Chainbase-Labs/Theia-Llama-3.1-8B-v1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
KONI Llama3.1 8B R Preview 20250320
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Ablation 135 Geniac.Gbs128.2E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AB
ablation 28 rafathenev2.tulu shisa v2 tulu3 8b
Ablation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing