GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Meta Llama 3.1 8B Instruct
Llama · ManthanLabs
Params8.03B
Context128K
Smallest8.5 GB
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mohdAlal1
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange dsp
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange blender
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
BigTalker Lite 8B
Bigtalker · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
Danilas/Hf3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange chemistry
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
unsloth/Meta-Llama-3.1-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · dabr1
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct abliterated.Q4 K M
Llama · Bluerosesbutterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mtsdurica
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama VARCO 8B Instruct
Llama · jjjssjs
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct
Llama · mobilint
Params1B
Context4K
Smallest0.0 GB
ML
mlfoundations dev OH DCFT V3 wo platypus
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
Mlx Community Meta Llama 3.1 70B Instruct Bf16 CORRECTED
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
NE
ckoozzzu/new1
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q6 K
Llama · raissadev
Params8.03B
Context128K
Smallest6.6 GB
ST
stackexchange avp
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange matheducators
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange cogsci
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Smarteaz V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored Q6 K
Llama · jott1970
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 8b DeepDive 3 Prev v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B instruct 2512
Llama · Mati83moni
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · xaskasdf
Params8.03B
Context128K
Smallest2.9 GB
DC
oh dcft v3.1 SN 405B hacky
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange christianity
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB