GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo alpaca threshold90 it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 27 rafathenev2.9epochs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball R1.1 Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
ML
mlfoundations dev oh v3 1 only camel math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LW
LwQ 30B Instruct
Lwq · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
oh dcft v3.1 llama 3.2 3b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.x 8b Smarteaz 0.2 R1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 11b pretrained
Llama · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
GGUF
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama SEA LION v3 8B IT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 82 bestofn.random shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Astraea Prompt Architect Chat v10
Llama · braydenh563
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
NousResearch/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
computer 10
Computer · neuroscr
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ZE
ZEUS 8B V30
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Locutusque/Apollo-2.0-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Openbuddy Llama3.1 70b v23.2 131k Sftonly
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 alpaca x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B BLEUBERI
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ME
Mercury In Retrograde 8b Model Stock
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange movies
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Herrsimian 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Krikri 8B Base
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Llama3.1 8B PlumChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange bitcoin
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
adi llama 3.1 8b ablit glm5.2
Llama · AdvancedDataIntelligence
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
Danilas/test3
Test · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Tess R1 Limerick Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning

Keep browsing