GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
xLAM
Llama · sunkencity
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Sahabat AI v2 70B IT Q3 K S
Llama · blackshell69
Params70.6B
Context128K
Smallest30.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · freakyXO
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
OpenMath2 Llama3.1 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Vic0705
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 12 raswallow shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Grpo Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
reflection llama 3.1 8B Solshine trainround3 16bit Q4 K M
Llama · aashish1904
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · rrevo
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
MFANN llama3.1 abliterated SLERP v3.1 Q6 K
Llama · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 Q3 K L
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
ReasoningTool use
ME
Megatron Opus 7B Exp
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
ReasoningTool use
LL
Llama 3.1 Amelia SD 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct gguf q4 k m
Llama · keisuke-miyako
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
EX
kg extraction model
Extraction · n9102125
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev openthoughts3 30k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Szabi Llama v8
Llama · jabba77
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · Felladrin
Params8.03B
Context128K
Smallest3.7 GB
GGUF
LL
Llama 3.1 Tulu 3 8B abliterated Q4 K M
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · Neuwhufbox
Params8.03B
Context8K
Smallest5.7 GB
Tool use
LL
Llama 3.1 Carballo
Llama · sdocio
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · CodingToni
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Hercules 6.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Openbuddy Llama3.1 70b v23.1 131k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
AL
alloma 8b q4
Alloma · kmamaroziqov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing