GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Swallow 70B Instruct v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Hercules 6.1 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
PY
PyThagorean 10B
Pythagorean · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Llama 3.1 8B Instruct NVFP4
Llama · prithivMLmods
Params8.03B
Context128K
Smallest6.0 GB
LL
wraith 8b
Llama · vanta-research
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · wyattjo116
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.1 no curation
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ilsp.Llama Krikri 8B Base
Llama · DevQuasar-7
Params8.2B
Context128K
Q4_K_M5.0 GB
ML
mlfoundations dev oh v1.3 camel chemistry x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KokoroChat Low
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
Megatron
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
DA
Dare_Angel_8B
Dare · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B Middo Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 70B Instruct v0.3
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
VI
Vire Protocol 70b
Vire · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CE
L3.1 8B Celeste V1.5
Celeste · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
AN
L3.1 8B Animus V12.2
Animus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Middo Alpaca 4o Mini
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Mediver V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Gemma 2 27b CPO SimPO iter2 i1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
openthoughts3 10k llama3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Fusion 6040
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia OpenMath2 Llama3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama SEA Guard 8B 2602
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
irlab udc Llama 3.1 8B Instruct Galician
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Gemma 2 27b ORPO iter3
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · R4xx1
Params8.03B
Context128K
Q4_K_M4.9 GB