GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
MF
MFANNv0.22.1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MDCure LLAMA3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArliAI RPMax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Mims Harvard TxAgent T1 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 KokoroChat Full
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Instruct ArtexIT Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Gutenberg Doppel 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MFANN llama3.1 abliterated SLERP v3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
Magpie Align MagpieLM 8B SFT v0.1
Magpie · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive R1 V1.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 gpt 4o mini
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Base 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo camel biology gpt 4o mini
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 0.1
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo camel chemistry gpt 4o mini
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA 3.1 Turkis 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Gpt Oss 120b Distill Llama3.1 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
llama3.1 typhoon2 deepseek r1 70b preview
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AI
airoboros none resp gpt 4o mini inst gpt 4o resp
Airoboros · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB