GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Cogito v2 Preview Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 8B DPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Megatron Opus 14B 2.0
Megatron · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LL
Llama3.1-70B-Chinese-Chat
Llama · shenzhi-wang
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Unhinged Vision 8B
Llama · YuujiLab
Params8.03B
Context8K
Q4_K_M4.9 GB
Vision
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EG
Egregore Alice RP NSFW 4B i1
Egregore · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
Roleplay
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama SEA LION v3 8B IT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ZE
ZEUS 8B V17 abliterated V4 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
DO
Dolphin Email 8b
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama3.1 8b instruct LLMPC Red Team
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LW
LwQ Reasoner 10B i1
Lwq · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
MI
MIST Mini 8B Thinking
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
GGUF
LL
Llama 3.1 EstLLM 8B Instruct 1125
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dobby Mini Unhinged Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
MO
L3.1 Moe 2x8B v0.2 i1
Moe · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
GGUF
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing