GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Nemotron 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
KONI Llama3.1 8B Instruct 20241024
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Theia Llama 3.1 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
BE
Bella Bartender v2 8b
Bella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Flammades 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DC
oh dcft v3.1 gemini 1.5 flash i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolermed V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reasoning Llama 3.1 CoT RE1 NMT V3 ORPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EstLLM 8B Instruct 0825
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KONI Llama3.1 8B R 20250831
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SauerHuatuoSkyworkDeepWatt O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo gpt4 llm
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LO
loki erotica 8b
Loki · forkjoin-ai
Params8.03B
Context1024K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 0.3
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 2 only alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
EI
L3.1 EinsteinCobaltBioCoder 8B ModelStock i1
Einsteincobaltbiocoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HuatuoSkywork O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 opengpt x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dorna2 Llama3.1 8B Instruct
Llama · aeranginkaman
Params8.03B
Context128K
Smallest8.5 GB
LL
Laravel 11 Llama 3.1 8B Instruct
Llama · yannelli
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 2 only metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Theia Llama 3.1 8B v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Base 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
artifex rp orpheus llama 3.1 8b
Llama · darthcrawl
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 evol instruct x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AR
ArlowGPT 8B
Arlowgpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia AQ 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 slim orca x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB