GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · reks229
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Middo Alpaca 4o Mini
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
EIRTHAIMED/Llama-3.1-EIRAI-8B-Prob
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · ArliAI
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Gradient Llama 3.1 8B Instruct 1048k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackoverflow 25000tasks .5p
Stackoverflow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NO
mlfoundations dev OH original wo dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
JailBreakLLMv1
Llama · RaselAntor
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ML
mlfoundations dev oh v1.3 slim orca x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange math
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
HermesNova Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CE
L3.1 8B Celeste V1.5
Celeste · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 70B v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Dragon Llama 3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
KISTI-KONI/KONI-Llama3.1-8B-R-Preview-20250320
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B bnb 4bit instruct
Llama · helloollel
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
jbjeong91 llama3.1 cpo j full 0911
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
oh dcft v3.1 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oxford llms llama3 1 ox llms 8b dpo full
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AL
AlignXpert PBA Subset
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
irlab-udc/Llama-3.1-8B-Instruct-Galician
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta llama 3.1 8b
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B SmileyLlama 1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
pangasinan llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ST
stackoverflow 25000tasks .25p
Stackoverflow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Daredevilish Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
omed llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Aisingapore Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
nbeerbower Llama3.1 Gutenberg Doppel 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing