GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · jinmrong
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Kondara
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 24 rafathenev2.lesswarmup shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 anime llm
Llama · kujirahand
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B Q8 0
Llama · AtlaAI
Params8.03B
Context128K
Smallest8.5 GB
Tool use
TE
L3.1 RP test2
Test · sal076
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
Meta Llama 3.1 8B Instruct Torchtune Fare Rule All Airline Name 5 Sep 2024
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
SA
Sao10K_L3.1 70B Euryale v2.2
Sao · NexesQuants
Params70.6B
Context128K
Smallest34.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · latentheat
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMA Mesh
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
OR
OH original wo null sources
Original · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
SauerHuatuoSkywork O1 Llama 3.1 8B
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Ablation 132 Geniac.Gbs128.1E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningTool use
LL
Llama 3.1 Storm 8B
Llama · freakyXO
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · ahashan-habib-eatl
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q3 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
CodingRoleplayTool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Trisert
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Cogito v1 Preview Llama 8B
Llama · WSDW
Params8.03B
Context128K
Smallest4.0 GB
ReasoningTool use
LL
Llama 3.1 Swallow Amateras 8b Instruct v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Ablation 130 Shisav2.Gbs128.5E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Defne llama3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama fine tune Cybersecucity
Llama · basilmh25
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · MugenYume
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Laravel 11 Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · vaibhavsatpathy
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Carf Llama 8b v5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · jimmylam6666
Params8.03B
Context128K
Smallest8.5 GB
Roleplay

Keep browsing