GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
DC
oh dcft v3.1 gpt 4o 2024 11 20 i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Fusion 5050
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch2 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WA
WangchanLION v3 i1
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev OH original wo caseus custom
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 ARC Heavy Induction 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
WI
Wingless Alice RP NSFW 8B
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
CSM 1.0
Llama · lkl387
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Tess 3 Llama 3.1 405B
Llama · bartowski
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
DI
Distilled DarkPlanet Allades 8B i1
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin3 Cyber 8B
Dolphin · kepom
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev stackoverflow 5000tasks .25p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Bella Bartender 8b Llama3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Mahou 1.5 llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 10B Instruct i1
Llama · mradermacher
Params9.99B
Context128K
Q4_K_M6.1 GB
Tool use
DA
Dare_Angel_8B
Dare · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b DeepDive 3 R1 Prev v1.0 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
llama 3.1 natural farmer 16bit i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LongWriter Llama3.1 8b Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Magpie Align SFT v0.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 SuperHawk 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange fitness
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo gpteacher
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Clin REACT 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Poro 2 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing