GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align v0.2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct lorablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Carballo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball R1.1 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama UK Legislation 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 70B R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo camel ai chemistry
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Bella Bartender v2 Moody 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Tess 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DO
DongfuJiang prm version2 subsample hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Enigma
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
unsloth/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FinR1 Llama 8b Multi Language Thinking
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 SuperHawk 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
KU
Kumiho V1 rp UwU 8B
Kumiho · juvi21
Params8.03B
Context128K
Q4_K_M4.9 GB
OU
oumi l8b ultrachat i1
Oumi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
simonycl llama 3.1 8b instruct ultrafeedback agg judge
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 opengpt x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo airoboros
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
PL
plutus 8B instruct
Plutus · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 typhoon2 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
RACE CoT Extractor Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB