GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Magpie Align v0.2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B Instruct lorablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Carballo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball R1.1 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama UK Legislation 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama SEA LION v3.5 70B R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
mlfoundations dev llama3 1 8b oh v3.1 wo camel ai chemistry
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
BE
Bella Bartender v2 Moody 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Tess 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DO
DongfuJiang prm version2 subsample hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Enigma
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
unsloth/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
FinR1 Llama 8b Multi Language Thinking
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.1 SuperHawk 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
KU
Kumiho V1 rp UwU 8B
Kumiho · juvi21
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
OU
oumi l8b ultrachat i1
Oumi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
simonycl llama 3.1 8b instruct ultrafeedback agg judge
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 opengpt x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo airoboros
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PL
plutus 8B instruct
Plutus · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3.1 typhoon2 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
RACE CoT Extractor Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing