GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hercules 6.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AD
Adversary 8B v1.21
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama3.1 SuperHawk 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 8B SmileyLlama 1.1 Prompt Following
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 70B Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B Instruct Heretic
Llama · logos-flux
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Llama 8B Abliterated
DeepSeek · PocketWeights
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
EpistemeAI.Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO
Llama · DevQuasar-9
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
mlfoundations dev hp ablations llama3 epoch4
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 8B Distill CoT
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
ZE
ZEUS 8B V17 abliterated V4
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Thespis Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
MO
Mox Tiny 1
Mox · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama OpenReviewer 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
nvidia.Llama 3.1 Nemotron 70B Instruct HF
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
mlfoundations dev hp ablations llama3 epoch3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DH
Dhenu2 In CRSA Exp
Dhenu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Megatron Opus 7B Exp
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
ReasoningTool use
LL
oh dcft v3.1 llama 3.1 405b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
ablation 36 cmrmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
LL
Llama PLLuM 8B Chat 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oxford llms llama3 1 ox llms 8b sft full
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 14 ratulu405b shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing