GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B
Llama · Plana-Chan
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MagpieLM 8B Chat v0.1 Q4 K M
Magpielm · ijohn07
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Ckoozzzu New1
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MF
MFANNv0.25 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · pytholic
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Fredred89
Params8.03B
Context128K
Smallest5.2 GB
GGUF
LL
Llama 3.1 8B Instuct Uz Q4 K M
Llama · azimjon
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · sgerhart
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · Moha2305
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
hotep kush v3
Llama · hotepfederales
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · Moha2305
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
BRAG Llama 3.1 8b v0.1 Q4 K M
Llama · VenkatNDivi77
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Llama 3.1 Storm 8B
Llama · Alvant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B R1 Distill
Llama · justinj92
Params8.03B
Context128K
Smallest8.5 GB
CodingReasoning
LL
Llama PLLuM 8B Base 2512
Llama · Jerzman
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · e2jhiubyiiyvw
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · vaibhavsatpathy
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · wencan-lab
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Bustion
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · dsouza889
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · Mimi-333
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q3 K S
Llama · aswdaegrhjklasdgfhjklasdgfhjkl
Params8.03B
Context128K
Smallest3.7 GB
GGUF
ML
mlfoundations dev oh v1.3 camel math x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
AK
akin yurt finely
Akin · aab20abdullah
Params8.03B
Context128K
Smallest4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
CodingRoleplayTool use
LL
Llama PRM800K
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 8B TXT2JSON FT Q4 K M
Llama · wyzhaoc
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing