GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
KONI Llama3.1 8B Instruct 20241024
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Theia Llama 3.1 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
BE
Bella Bartender v2 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama3.1 Flammades 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DC
oh dcft v3.1 gemini 1.5 flash i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Dolermed V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 EstLLM 8B Instruct 0825
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KONI Llama3.1 8B R 20250831
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SauerHuatuoSkyworkDeepWatt O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo gpt4 llm
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LO
loki erotica 8b
Loki · forkjoin-ai
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down random 0.3
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1 2 only alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EI
L3.1 EinsteinCobaltBioCoder 8B ModelStock i1
Einsteincobaltbiocoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
HuatuoSkywork O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 opengpt x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dorna2 Llama3.1 8B Instruct
Llama · aeranginkaman
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Laravel 11 Llama 3.1 8B Instruct
Llama · yannelli
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
ML
mlfoundations dev oh v1 2 only metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Theia Llama 3.1 8B v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 70B Base 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
artifex rp orpheus llama 3.1 8b
Llama · darthcrawl
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ML
mlfoundations dev oh v1.3 evol instruct x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Tess 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AR
ArlowGPT 8B
Arlowgpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Amelia AQ 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 slim orca x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing