GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
openthoughts3 30k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · tianyixueyuan
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b ape fiction Q5 K M
Llama · leftyfeep
Params8.03B
Context128K
Smallest5.7 GB
LL
lexsg
Llama · sausheong
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Chat
Llama · adach27
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · lemon-mint
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · andquant
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 70b Tears V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
BA
barc0 transduction 40k seed100 instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · Renesas
Params8.03B
Context128K
Smallest16.1 GB
LL
Meta Llama 3.1 8B Instruct
Llama · hanchungshin
Params8.03B
Context128K
Smallest4.7 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · Cran-May
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
L3.1 70Blivion v0.1 Rc1 70B
Blivion · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Amelia AQ 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama 3.1 8B
Llama · jtjones
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
LL
Llama 3.x 70b TDRussel Storywriter 128K Dop v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Dorna2
Llama · heydariAI
Params8.03B
Context128K
Smallest8.5 GB
LL
Reasoning Llama 3.1 CoT RE1 Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
mlfoundations dev openthoughts3 1k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · hoorang
Params8.03B
Context128K
Smallest8.5 GB
LL
ablation 16 rafbestmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 8b mlfoundations dev stackexchange scicomp
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
lserinol Llama O 3 8B levent
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB