GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8b Mediver V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
s1K llama3.1 8b 32kcontext
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev.stackexchange devops
Mlfoundations · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · DaKitch
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
MagpieLM 8B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama3.1 IgneousIguana 8B Q4 K M
Llama · Yuma42
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Impish_LLAMA_4B
Llama · cpu-quants-heaven
Params4.51B
Context128K
Smallest2.4 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Marlon81
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infortun IA
Llama · Nick06888
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev openthoughts3 3k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
llama3 1 8b mlfoundations dev stackexchange scifi
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange quant
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Open Finance 8B
Llama · gauravgupta81
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Q4_K_M4.9 GB
UN
unsloth.Q4 K M
Unsloth · ddenes
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev oh v1.3 metamath x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 8b abliterated uncensored
Llama · rooocs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HODACHI Llama 3.1 8B EZO 1.1 it
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Smallest6.6 GB
LL
Reasoning Llama 3.1 CoT RE1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
LL
ablation 37 rafathenev2.cmrmix shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.02
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama gRPo thoughtprocess
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
LL
Protocol0 Llama 3.1 8b v5
Llama · SoulInPsyAbstract
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Guard 3 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB