GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · antoste
Params8.03B
Context128K
Smallest3.8 GB
Tool use
LL
Deepcogito Cogito v1 Preview Llama 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · HeRksTAn
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin X1 8B
Dolphin · ling1000T
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · kkwagh999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange philosophy
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange or
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Metabolic Llama V1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit model stock zengbax
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Swallow 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
lora Meta Llama 3.1 8B Instruct
Llama · weber50432
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
llama 3.1 8b conservative christian worldview 10k pairs
Llama · sarileyman
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Function Calling Agent
Llama · Berhak
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
VI
Vivian12300 bottom ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Reasoning Llama 3.1 CoT RE1 i1 IQ3 M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.8 GB
ReasoningTool use
LL
Meta Llama 3.1 70B Instruct
Llama · Isvara
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama3.1 70b Cpt Sea Lionv3 Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
fabricator
Llama · redcathode
Params21M
Context—
Smallest0.1 GB
GGUF
LL
reflection llama 3.1 8B Solshine trainround3 16bit Q4 K M
Llama · Solshine
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3.1 8b instruct 07 24
Llama · xaskasdf
Params8.03B
Context128K
Smallest2.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
CodingRoleplayTool use
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct
Llama · adonald
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Llama 3.1 8B
Llama · NbAiLab
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest4.7 GB
GGUF
ST
stackexchange webapps
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b Q8 0
Llama · SYNERDATA
Params8.03B
Context128K
Smallest8.5 GB
Coding
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · Recouper
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing