GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama3.1 8b instruct LLMPC Blue Team i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.9
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 3B Instruct
Llama · mradermacher
Params3.11B
Context128K
Q4_K_M2.0 GB
ML
mlfoundations dev oh v1.3 evol instruct x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 TitanDeluxe 8B Slerp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · starble-dev
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Bella Bartender 8b Llama3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama/Llama-Guard-3-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b Leetcoder
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Techne RP 8b v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Carvalho PT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel biology x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Base
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
BR
BrownLoafers 70B
Brownloafers · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1_OpenScholar 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fiendish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · stratalab-org
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natural Synthesis 8b 3.1 v5
Llama · JPQ24
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PR
Prompt Injection Defender 8b
Prompt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
MF
MFANNv0.25 i1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PR
Prompt Injection Judge 8b
Prompt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Bella Bartender v2 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
fikri 3.1 8B Instruct
Fikri · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepthought 8b abliterated i1
Deepthought · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB