GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
IO
IoT Mash Up Model 08 19
Iot · evantsao
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · hope-hui
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Refined Codex 5.5
Llama · shounakpatra
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · pmathis89
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · wfby
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · swilde42
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct.q4 0 4 4 arm
Llama · SamPurkis
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
refusal llama3 8b
Llama · msilich
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Marlon81
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · RichardErkhov
Params70.6B
Context128K
Smallest26.4 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama3.1 SuperDeepFuse CrashCourse12K
Llama · anester
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.5 GB
Reasoning
LL
nicoboss.Hermes 3 Llama 3.1 405B Uncensored
Llama · llmtraining-scraper
Params406B
Context128K
Smallest149.3 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · WongBingbing
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 70B Instruct.Q4 0
Llama · gbueno86
Params70.6B
Context128K
Smallest40.0 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
Reasoning
LL
Meta Llama 3.1 8B
Llama · dsouza889
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 Quantized 4bit
Llama · PersonalAILabs
Params70.6B
Context128K
Smallest4.5 GB
Tool use
LL
Llama3.1 8B Chinese Chat
Llama · yemiao2745
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CE
L3.1 8B Celeste V1.5 Q3 K M
Celeste · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
GGUF
FA
L3.1 8B Fabula Q8 0
Fabula · BusRune
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · wareef
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AN
Anna15 Hf2
Anna · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ST
stackexchange chinese
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA Mesh
Llama · CronoBJS
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
KONI Llama3.1 8B Instruct 20241024
Llama · suminimini
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · Manel
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
Reasoning

Keep browsing