GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · ChrisChung
Params8.03B
Context128K
Smallest3.7 GB
GGUF
LL
redstring 8gb
Llama · tspec2
Params8.03B
Context128K
Smallest8.5 GB
GGUF
DE
deepthought 8b abliterated Q8 0
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
llama 3.1 8b instruct Q4 K M
Llama · jaslatendresse
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
German RAG LLAMA 3.1 8B ORPO HESSIAN AI Q8 0
Llama · avemio
Params8.03B
Context128K
Smallest8.5 GB
Reasoning
LL
openthoughts3 10k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 06 ratulu70b shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · matfyzacek
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B R1 Distill
Llama · justinj92
Params8.03B
Context128K
Smallest8.5 GB
CodingReasoning
LL
Meta Llama 3.1 8B Instruct.Q4 0 4 4
Llama · gbueno86
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 SyntheticPython 8B Base
Llama · ericflo
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B
Llama · gurro
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WI
Wingless_Imp_8B_Abliterated
Wingless · thirteenbit
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b Q4 K S
Llama · skyline9394
Params8.03B
Context128K
Smallest4.7 GB
Coding
ME
mellow mate 8b
Mellow · Gurubot
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · hellork
Params8.03B
Context128K
Smallest3.8 GB
GGUF
LL
Llama 3.1 ARC Heavy Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · leafspark
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · wangrongsheng
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · kpranav22
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CE
L3.1 8B Celeste V1.5 Q2 K
Celeste · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 21 rafbestseq.2epoch shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · polyverse
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama 3.1 8B Instruct LegalCite
Llama · seasparks
Params8.03B
Context128K
Smallest4.9 GB
Tool use
LL
meta llama Llama 3.1 70B Instruct FP16
Llama · jesse-r-s-hines
Params4M
Context128K
Smallest0.0 GB
GGUF
FA
fabricator Q4 K M
Fabricator · redcathode
Params13M
Context128K
Q4_K_M0.0 GB
Tool use
LL
Cogito v1 Preview Llama 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
LL
Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest3.7 GB
GGUF

Keep browsing