GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Meta Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
LL
xLAM
Llama · sunkencity
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Sahabat AI v2 70B IT Q3 K S
Llama · blackshell69
Params70.6B
Context128K
Smallest30.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · freakyXO
Params8.03B
Context128K
Smallest4.7 GB
LL
OpenMath2 Llama3.1 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Vic0705
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 12 raswallow shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Grpo Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reflection llama 3.1 8B Solshine trainround3 16bit Q4 K M
Llama · aashish1904
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · rrevo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 Q6 K
Llama · netcat420
Params8.03B
Context128K
Smallest6.6 GB
LL
Reasoning Llama 3.1 CoT RE1 Q3 K L
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
ME
Megatron Opus 7B Exp
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
Llama 3.1 Amelia SD 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct gguf q4 k m
Llama · keisuke-miyako
Params8.03B
Context128K
Q4_K_M4.9 GB
EX
kg extraction model
Extraction · n9102125
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev openthoughts3 30k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Szabi Llama v8
Llama · jabba77
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 SuperNova Lite
Llama · Felladrin
Params8.03B
Context128K
Smallest3.7 GB
LL
Llama 3.1 Tulu 3 8B abliterated Q4 K M
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · Neuwhufbox
Params8.03B
Context8K
Smallest5.7 GB
LL
Llama 3.1 Carballo
Llama · sdocio
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · CodingToni
Params8.03B
Context128K
Smallest8.5 GB
LL
Hercules 6.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Smallest8.5 GB
LL
Openbuddy Llama3.1 70b v23.1 131k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 camel biology x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
AL
alloma 8b q4
Alloma · kmamaroziqov
Params8.03B
Context128K
Q4_K_M4.9 GB