GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · ChrisChung
Params8.03B
Context128K
Smallest3.7 GB
LL
redstring 8gb
Llama · tspec2
Params8.03B
Context128K
Smallest8.5 GB
DE
deepthought 8b abliterated Q8 0
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
LL
llama 3.1 8b instruct Q4 K M
Llama · jaslatendresse
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
German RAG LLAMA 3.1 8B ORPO HESSIAN AI Q8 0
Llama · avemio
Params8.03B
Context128K
Smallest8.5 GB
LL
openthoughts3 10k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 06 ratulu70b shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · matfyzacek
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B R1 Distill
Llama · justinj92
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct.Q4 0 4 4
Llama · gbueno86
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 SyntheticPython 8B Base
Llama · ericflo
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B
Llama · gurro
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
Wingless_Imp_8B_Abliterated
Wingless · thirteenbit
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Q4 K S
Llama · skyline9394
Params8.03B
Context128K
Smallest4.7 GB
ME
mellow mate 8b
Mellow · Gurubot
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · hellork
Params8.03B
Context128K
Smallest3.8 GB
LL
Llama 3.1 ARC Heavy Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · leafspark
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3.1 8B Chinese Chat
Llama · wangrongsheng
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · kpranav22
Params8.03B
Context128K
Q4_K_M4.9 GB
CE
L3.1 8B Celeste V1.5 Q2 K
Celeste · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 21 rafbestseq.2epoch shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · polyverse
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.1 8B Instruct LegalCite
Llama · seasparks
Params8.03B
Context128K
Smallest4.9 GB
LL
meta llama Llama 3.1 70B Instruct FP16
Llama · jesse-r-s-hines
Params4M
Context128K
Smallest0.0 GB
FA
fabricator Q4 K M
Fabricator · redcathode
Params13M
Context128K
Q4_K_M0.0 GB
LL
Cogito v1 Preview Llama 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest3.7 GB