GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 8b instruct LLMPC Blue Team i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.9
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Elm Turbo 3B Instruct
Llama · mradermacher
Params3.11B
Context128K
Q4_K_M2.0 GB
GGUF
ML
mlfoundations dev oh v1.3 evol instruct x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 TitanDeluxe 8B Slerp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · starble-dev
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Bella Bartender 8b Llama3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-Guard-3-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b Leetcoder
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 Techne RP 8b v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama Carvalho PT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Krikri 8B Base
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
BR
BrownLoafers 70B
Brownloafers · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1_OpenScholar 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · stratalab-org
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Natural Synthesis 8b 3.1 v5
Llama · JPQ24
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PR
Prompt Injection Defender 8b
Prompt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MF
MFANNv0.25 i1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PR
Prompt Injection Judge 8b
Prompt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
BE
Bella Bartender v2 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
FI
fikri 3.1 8B Instruct
Fikri · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B
Llama · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down random 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
deepthought 8b abliterated i1
Deepthought · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing