GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Megatron Opus 14B 2.0
Megatron · prithivMLmods
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
UN
unlimited ocr
Unlimited · forkjoin-ai
Params2.93B
Context32K
Q4_K_M2.0 GB
GGUF
CK
ckoozzzu/d3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange interpersonal
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
AL
AlignXpert ICA Subset
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Grpo Reasoning i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
tokyotech-llm/Llama-3.1-Swallow-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
ablation 02 llama31 shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama Augmentoolkit Quickstart Factual Demo Example
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · bullerwins
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama guard 3 8b
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · RichardErkhov
Params6.29B
Context128K
Q4_K_M3.9 GB
GGUF
LL
Apollo 2.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SU
SuperHeart i1
Superheart · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B NexaQuant
DeepSeek · NexaAI
Params8.03B
Context128K
Smallest5.3 GB
ReasoningTool use
LL
ablation 09 rafllama33 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 AlternateTokenizer
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
tanliboy zephyr llama 3 8b sft
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q2 K
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
llama3.1 8b chat brainstorm v3.1
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
tanliboy/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
tokyotech-llm/Llama-3.1-Swallow-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Ko 4oDistil Heresy DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Nvidia OpenMath2 Llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 8b Dolermed R1 V1.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Apollo 0.4 Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use

Keep browsing