GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8b Mediver V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
s1K llama3.1 8b 32kcontext
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ML
mlfoundations dev.stackexchange devops
Mlfoundations · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · DaKitch
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
MA
MagpieLM 8B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Llama3.1 IgneousIguana 8B Q4 K M
Llama · Yuma42
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Impish_LLAMA_4B
Llama · cpu-quants-heaven
Params4.51B
Context128K
Smallest2.4 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Marlon81
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infortun IA
Llama · Nick06888
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev openthoughts3 3k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange scifi
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange quant
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Open Finance 8B
Llama · gauravgupta81
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UN
unsloth.Q4 K M
Unsloth · ddenes
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ML
mlfoundations dev oh v1.3 metamath x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8b abliterated uncensored
Llama · rooocs
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
HODACHI Llama 3.1 8B EZO 1.1 it
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
LL
ablation 37 rafathenev2.cmrmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
LL
Llama 3.1 8b DodoWild v2.02
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama gRPo thoughtprocess
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Protocol0 Llama 3.1 8b v5
Llama · SoulInPsyAbstract
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 8B
Llama · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Guard 3 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing