GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cogito v2 Preview Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 8B DPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Megatron Opus 14B 2.0
Megatron · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
LL
Llama3.1-70B-Chinese-Chat
Llama · shenzhi-wang
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Unhinged Vision 8B
Llama · YuujiLab
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
EG
Egregore Alice RP NSFW 4B i1
Egregore · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama SEA LION v3 8B IT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V17 abliterated V4 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
Dolphin Email 8b
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b instruct LLMPC Red Team
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LW
LwQ Reasoner 10B i1
Lwq · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
MI
MIST Mini 8B Thinking
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
LL
Llama 3.1 EstLLM 8B Instruct 1125
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
L3.1 Moe 2x8B v0.2 i1
Moe · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB