GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ML
mlfoundations dev oh v1 2 only camel biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ambuj Tripathi Llama 3.1 8B IndianLegal
Llama · invincibleambuj
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama3.1 typhoon2 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
openthoughts3 100k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolerstormed V1.04 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
L3.1 8b RP Ink
Ink · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Evilguy_Gguf
Llama · anyalkonsafe
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dirty Alice RP NSFW llama 4B
Llama · D1rtyB1rd
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama SEA LION v3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
huihui-ai/Meta-Llama-3.1-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Stormeder v1.04 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EI
L3.1 EinsteinCobaltBioCoder 8B ModelStock
Einsteincobaltbiocoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
allura org.L3.1 8b RP Ink
Ink · DevQuasar-9
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm version3 subsample no ref hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo metamath 40k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo unreplicated
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hercules 6.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Medusa v1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mattshumer Reflection Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3_1 8B Instruct AMD Python
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev evol tt 1s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlabonne Llama 3.1 70B Instruct lorablated
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
EIRTHAIMED/Llama-3.1-EIRAI-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Llama3.1 v1.0 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB