GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
KISTI-KONI/KONI-Llama3.1-70B-Instruct-20241115
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B Instruct
Llama · etemiz
Params70.6B
Context128K
Smallest15.3 GB
LL
Llama 3.1 8b DodoWild v2.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DevQuasar llama3.1 8b chat brainstorm v3.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b science sft
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DI
Distilled DarkPlanet Allades 8B TIES
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev OH DCFT V3 wo unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
MY
myalee v3 L31 8B
Myalee · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Filipino llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
MA
magpielm 8b sft v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama OpenReviewer 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Hotep Llm Kush v82 Gguf Q4_K_M
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hastagaras/Llama-3.1-8B-Tortoise
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · LaniakeaPH
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 174 Shisav2.If50.Tltweak Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cebuano llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama Sahabat AI v2 70B IT
Llama · komixenon
Params70.6B
Context128K
Smallest26.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mukel
Params8.03B
Context128K
Smallest4.5 GB
DC
oh dcft v1.3 no curation gpt 4o mini scale 0.125x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
oh dcft v3.1 qwen 2.5 72b
Qwen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.1 405b v2dummytesting
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ChatParts Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Chainbase-Labs/Theia-Llama-3.1-8B-v1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KONI Llama3.1 8B R Preview 20250320
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 135 Geniac.Gbs128.2E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AB
ablation 28 rafathenev2.tulu shisa v2 tulu3 8b
Ablation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB