GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Aeon Q4
Llama · yusuf3416
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Thinking R1
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 70B R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
VI
Vire Protocol 70b
Vire · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama 3.1 8b taiwan chat
Llama · steven0226
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cogito v2 preview llama 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8b DodoWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ST
stackexchange crypto
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hercules 6.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GA
GasAslan/C1-3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Instruct Ind Tax Act 1961
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 30 rafathenev2.5epochs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 129 Shisav2.Gbs128.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HexaMind Llama 3.1 8B S21
Llama · s21mind
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · AbteeXAILab
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch1 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Nicefellow Reflection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DeepDive 3 R1 Prev
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b spaetzle v51 GGUF 1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
AN
L3.1 70B Animus V14.0 5810 16.0
Animus · Darkhn-Quants-3
Params70.6B
Context128K
Q4_K_M42.5 GB
LA
lapaliv 009
Lapaliv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 70b instruct 07 24
Llama · xaskasdf
Params70.6B
Context128K
Smallest27.6 GB
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 seed100 3
Barc · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev oh teknium scaling down random 0.8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only slim orca 550k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Oh Dcft v3.1 Llama 3.3 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Literotica 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 81 bestofn.athenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB