GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ME
Megatron Opus 14B 2.0
Megatron · prithivMLmods
Params14.7B
Context16K
Q4_K_M8.9 GB
UN
unlimited ocr
Unlimited · forkjoin-ai
Params2.93B
Context32K
Q4_K_M2.0 GB
CK
ckoozzzu/d3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange interpersonal
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
AL
AlignXpert ICA Subset
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Grpo Reasoning i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tokyotech-llm/Llama-3.1-Swallow-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
ablation 02 llama31 shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama Augmentoolkit Quickstart Factual Demo Example
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
CE
L3.1 8B Celeste V1.5
Celeste · bullerwins
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama guard 3 8b
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · RichardErkhov
Params6.29B
Context128K
Q4_K_M3.9 GB
LL
Apollo 2.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SU
SuperHeart i1
Superheart · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B NexaQuant
DeepSeek · NexaAI
Params8.03B
Context128K
Smallest5.3 GB
LL
ablation 09 rafllama33 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 AlternateTokenizer
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tanliboy zephyr llama 3 8b sft
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q2 K
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
LL
llama3.1 8b chat brainstorm v3.1
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tanliboy/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tokyotech-llm/Llama-3.1-Swallow-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Ko 4oDistil Heresy DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nvidia OpenMath2 Llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8b Dolermed R1 V1.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Apollo 0.4 Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB