GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
shisa v2 llama3.1 405b
Llama · shisa-ai
Params406B
Context128K
Q4_K_M243.1 GB
CE
CellHermes v1.0
Cellhermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BL
Blaze 14B xElite
Blaze · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
LL
Codette Llama 3.1 8b Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · HoneyBadger2989
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
oh dcft v3.1 qwen 2.5 72b i1
Qwen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Leonida
Llama · jgchaparro
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Instruct 2512
Llama · Jerzman
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DobHerHard R1 v1.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 5000tasks .5p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
XX
xxx777xxxASD L3.1 ClaudeMaid 4x8B
Xxx · RichardErkhov
Params24.9B
Context128K
Q4_K_M15.2 GB
NA
Naija Reviewer 8b v2
Naija · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Poro 2 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 MFANN 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · tripolskypetr
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
proxectonos/Llama-3.1-Carballo
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CL
Clarky
Clarky · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 evol instruct
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Locutusque Apollo 2.0 Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70B ShiningValiant2
Llama · DevQuasar-3
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
New Dawn Llama3.1 70b v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
shisa-v2-llama3.1-8b
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v1.3 no curation gpt 4o mini scale 2x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BRAG Llama 3.1 8b v0.1
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
LL
Lugha Llama 8B Wura
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V8 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
CounselingBotLlama3.18B
Counselingbotllama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB