GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
TU
tulu 3 sft mixture
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 63 rafathenev2.rp.tl.yahoo shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
verilog agent llama31 q4
Llama · TheMightyMaddy
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
finsentiment llama3.1
Llama · codex68
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 26 reasoning.inputs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Tulu 3 70B SFT
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
dolphin 2.9.4 llama3.1 8b Arm AArch64
Llama · freakyXO
Params8.03B
Context128K
Smallest4.7 GB
GGUF
VI
Vivian12300 new wiki model de
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange bioinformatics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange opensource
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EV
oh v1.3 evol instruct x.25
Evol · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange langdev
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Pensez Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Diffbot Small 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
BadApple O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Brinebreath Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DO
Dolphin X1 8B
Dolphin · notcaleb
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 typhoon2 70b instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 KoEn 8B Magic8
Llama · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange earthscience
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Reasoning
LL
Ablation 139 Shisav2.Ds.Gbs128.1E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8b Smarteaz V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Joywulf
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B Instruct
Llama · hope-hui
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Latam Gpt
Llama · Pragmir
Params70.6B
Context4K
Q4_K_M42.8 GB
GGUF
LL
Llama 3.1 8B
Llama · skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing