GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
TU
tulu 3 sft mixture
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 63 rafathenev2.rp.tl.yahoo shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
verilog agent llama31 q4
Llama · TheMightyMaddy
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
finsentiment llama3.1
Llama · codex68
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 26 reasoning.inputs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B SFT
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Arm AArch64
Llama · freakyXO
Params8.03B
Context128K
Smallest4.7 GB
VI
Vivian12300 new wiki model de
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange bioinformatics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange opensource
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EV
oh v1.3 evol instruct x.25
Evol · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange langdev
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Pensez Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Diffbot Small 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BadApple O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Brinebreath Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
DO
Dolphin X1 8B
Dolphin · notcaleb
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 typhoon2 70b instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KoEn 8B Magic8
Llama · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange earthscience
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Ablation 139 Shisav2.Ds.Gbs128.1E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Smarteaz V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Joywulf
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct
Llama · hope-hui
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Latam Gpt
Llama · Pragmir
Params70.6B
Context4K
Q4_K_M42.8 GB
LL
Llama 3.1 8B
Llama · skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB