GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct
Llama · ManthanLabs
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mohdAlal1
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange dsp
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange blender
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BigTalker Lite 8B
Bigtalker · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DA
Danilas/Hf3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange chemistry
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
unsloth/Meta-Llama-3.1-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · dabr1
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct abliterated.Q4 K M
Llama · Bluerosesbutterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mtsdurica
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama VARCO 8B Instruct
Llama · jjjssjs
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · mobilint
Params1B
Context4K
Smallest0.0 GB
Tool use
ML
mlfoundations dev OH DCFT V3 wo platypus
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Mlx Community Meta Llama 3.1 70B Instruct Bf16 CORRECTED
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
NE
ckoozzzu/new1
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored V2 Q6 K
Llama · raissadev
Params8.03B
Context128K
Smallest6.6 GB
Tool use
ST
stackexchange avp
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange matheducators
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange cogsci
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Smarteaz V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Instruct Fei v1 Uncensored Q6 K
Llama · jott1970
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Llama 3.1 8b DeepDive 3 Prev v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B instruct 2512
Llama · Mati83moni
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · xaskasdf
Params8.03B
Context128K
Smallest2.9 GB
Tool use
DC
oh dcft v3.1 SN 405B hacky
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange christianity
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing