GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8b DoberWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Magpie Align Llama 3.1 8B Magpie Align v0.1
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ME
Mercury In Retrograde ALT 8b Model Stock i1
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Sparse Llama 3.1 8B 2of4
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
LongWriter Llama3.1 8B Absolute Heresy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
rombodawg/Meta-Llama-3.1-8B-Instruct-reuploaded
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PN
L3.1 Pneuma 8B
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v3 1 only gpt4 llm
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TI
L3.1 Tivir v0.1 10B
Tivir · mradermacher
Params10.6B
Context128K
Q4_K_M6.5 GB
Roleplay
LL
Llama3.1 8B MegaScience
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo cot alpaca
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 133 Geniac.Gbs128.8E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
mlfoundations dev llama3 1 8b oh v3.1 wo dataforge economics
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · NightFuryTimo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
allenai.Llama 3.1 Tulu 3 405B
Llama · DevQuasar-7
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
BA
barc0 transduction run6 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3.1 8B
Llama · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IM
Impish_Mind_8B
Impish · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Medusa v1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
DS Distilled Hermes Llama 3.1 TIES
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DO
DongfuJiang prm gsm 2k with full sol mix ref error only hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev OH original wo platypus
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
BA
barc0 transduction run7 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · fluidapp
Params8.03B
Context128K
Smallest4.4 GB
Tool use
LL
HODACHI/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing