GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
mlabonne/Llama-3.1-70B-Instruct-lorablated
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stackexchange mythology
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama Spark
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q3 K M
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
LL
Reasoning Llama 3.1 CoT RE1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Ghost
Llama · Jhuang314
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 opengpt x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 08 rallama33 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ArliAI/Llama-3.1-8B-ArliAI-Indo-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev dcft orca agentinstruct 1M v1 cleaned
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange graphicdesign
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tokyotech llm Llama 3.1 Swallow 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3.1-8B-Instruct
Llama · mohammedqarnuon
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Joseph717171 Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama3.1 Daredevilish
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
leafspark/Llama-3.1-8B-MultiReflection-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange poker
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo sharegpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3.1-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b baseline infinity instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Crystalcareai/Meta-llama-3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SLIMER LLaMA3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Aisingapore Llama SEA LION v3 70B IT
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · helloollel
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Selene 1 Mini Llama 3.1 8B Q4 K M
Llama · AtlaAI
Params8.03B
Context128K
Q4_K_M4.9 GB