GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Hercules 6.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AD
Adversary 8B v1.21
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
LL
Llama3.1 SuperHawk 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B SmileyLlama 1.1 Prompt Following
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · logos-flux
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Llama 8B Abliterated
DeepSeek · PocketWeights
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
EpistemeAI.Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO
Llama · DevQuasar-9
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch4
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 8B Distill CoT
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ZE
ZEUS 8B V17 abliterated V4
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Thespis Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Mox Tiny 1
Mox · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama OpenReviewer 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
nvidia.Llama 3.1 Nemotron 70B Instruct HF
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev hp ablations llama3 epoch3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DH
Dhenu2 In CRSA Exp
Dhenu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Megatron Opus 7B Exp
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
oh dcft v3.1 llama 3.1 405b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
ablation 36 cmrmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Chat 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oxford llms llama3 1 ox llms 8b sft full
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 14 ratulu405b shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB