GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MF
MFANNv0.24 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama3.1 MFANN 8b Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Tulu 3 8B DPO Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Llama abadalabs hectron
Gemma · hectorruiz9
Params—
Context—
Smallest0.0 GB
GGUF
AI
AIGF
Aigf · se1250
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · ggbetz
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 8B Instruct
Llama · kabriel
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlabonne Llama 3.1 70B Instruct lorablated bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama PLLuM 8B Instruct
Llama · tsej
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 i1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
Reasoning
LL
Llama 3.1 8B Instruct
Llama · snefrika
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · ipropel
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Chinese Chat
Llama · qqqq-hf
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
pllum 8b instruct q5 k m
Llama · pswitala
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Cogito v1 Preview Llama 8B
Llama · ankandrew
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama 3.1 8B instruct
Llama · SandraJ
Params8.03B
Context128K
Smallest4.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · molipedia
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Defne llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · BrassLion
Params8.03B
Context128K
Smallest4.3 GB
Tool use
LL
Llama 3.1 70B LatamGPT SFT 1.0 IQ2 S
Llama · pabloreyespo
Params70.6B
Context4K
Smallest22.2 GB
GGUF
TU
turkishSentenceGenerater
Turkishsentencegenerater · yunus111
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3.1 leave out non v1.2 subsets
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · jitsi
Params8.03B
Context128K
Smallest8.5 GB
Tool use
NE
L3.1 nemotron sunfall v0.7.0 q4 k m
Nemotron · crestf411
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Openbuddy Llama3.1 70b v23.1 131k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · wishgoods
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · shaileshsarda
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · ShinnningPikachu
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Llama3.1 8B Chinese Chat
Llama · jimmylam6666
Params8.03B
Context128K
Smallest8.5 GB
GGUF

Keep browsing