GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
openthoughts3 30k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · tianyixueyuan
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b ape fiction Q5 K M
Llama · leftyfeep
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
lexsg
Llama · sausheong
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 8B Chat
Llama · adach27
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · lemon-mint
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · andquant
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 70b Tears V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
BA
barc0 transduction 40k seed100 instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · Renesas
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · hanchungshin
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · Cran-May
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BL
L3.1 70Blivion v0.1 Rc1 70B
Blivion · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Amelia AQ 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama 3.1 8B
Llama · jtjones
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
CodingRoleplayTool use
LL
Llama 3.x 70b TDRussel Storywriter 128K Dop v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Dorna2
Llama · heydariAI
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
mlfoundations dev openthoughts3 1k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
Reasoning
LL
Meta Llama 3.1 8B Instruct
Llama · hoorang
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
ablation 16 rafbestmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange scicomp
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
lserinol Llama O 3 8B levent
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing