GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Deepcogito.Cogito v1 Preview Llama 70B
Llama · csabakecskemeti
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DC
oh dcft v3.1 claude 3 5 haiku 20241022 i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.24 i1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uncensored Complete
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TR
Triangulum 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Reasoning
VA
Valiant Vanta 8B Dark Fusion
Valiant · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 IgneousIguana 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IN
L3.1 8b RP Ink i1
Ink · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B Aleph 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev stackoverflow 10000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DC
oh dcft v3.1 gemini 1.5 pro i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FI
FiscalOxLLM Base
Fiscaloxllm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LW
LwQ 10B Instruct
Lwq · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ML
mlfoundations dev stackoverflow 5000tasks .75p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · chatpig
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama3.1 8B Cobalt
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek llama3.1 HARI 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
MU
Multiclass Think RM 8B
Multiclass · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.6
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo collective cognition
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel chemistry x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct MedQA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing