GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
mlabonne/Llama-3.1-70B-Instruct-lorablated
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ST
stackexchange mythology
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama Spark
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q3 K M
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
Reasoning Llama 3.1 CoT RE1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 8B abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Ghost
Llama · Jhuang314
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
ML
mlfoundations dev oh v1.3 opengpt x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 08 rallama33 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ArliAI/Llama-3.1-8B-ArliAI-Indo-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev dcft orca agentinstruct 1M v1 cleaned
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange graphicdesign
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
tokyotech llm Llama 3.1 Swallow 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-8B-Instruct
Llama · mohammedqarnuon
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Joseph717171 Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
Llama3.1 Daredevilish
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
leafspark/Llama-3.1-8B-MultiReflection-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange poker
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo sharegpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b baseline infinity instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Crystalcareai/Meta-llama-3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
SLIMER LLaMA3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Aisingapore Llama SEA LION v3 70B IT
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · helloollel
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Selene 1 Mini Llama 3.1 8B Q4 K M
Llama · AtlaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing