GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ablation 11 rafathenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
behbudiy/Llama-3.1-8B-Instuct-Uz
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FI
Fino1 8B Uncensored DeLMAT
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev.OH DCFT V3 wo sharegpt
Mlfoundations · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 70b
Llama · afg1
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
GGUF
ST
stackexchange cooking
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo camel ai chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Darkrazgriz88
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama PLLuM 70B Base 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ST
stackexchange musicfans
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange genealogy
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · AntraxSS
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Blasphemer
Llama · sunkencity
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama SEA LION v3.5 8B R
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Mahou 1.5 llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ERP WHW
Llama · hanzag
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Hermedive V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
nicoboss.Hermes 3 Llama 3.1 405B Uncensored
Llama · DevQuasar-14
Params406B
Context128K
Smallest149.3 GB
Tool use
ML
mlfoundations dev oh v1 2 only opengpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · sdalemorrey
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AN
L3.1 8B Animus V12.2
Animus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 70B Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Crystalcareai/meta-llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
L3.1 Moe 4x8B v0.1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
Tool use
VI
Vivian12300 full ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
nongfuyulang engineer heavy 500k barc llama3.1 8b ins fft induction lr1e 5 epoch3 1122
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Llama 3.1 8B Instruct
Llama · croswil
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Krikri Cypriot 8B v0.1
Llama · themetron
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use

Keep browsing