GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · SanctumAI
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Guard 3 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
DO
Dolphin X1 8B
Dolphin · dphn
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QI
QiMing Holos Plus 8B
Qiming · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LlamaScientific 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Tulu 3 8B
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
MA
MagpieLM 8B Chat v0.1 i1
Magpielm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · yaneivan
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
CA
calme-2.3-legalkit-8b
Calme · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Mox Tiny 1
Mox · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
Tool use
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
LL
Meta llama_Meta Llama 3.1 8B Instruct
Llama · ThomasBaruzier
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin3 Cyber 8B
Dolphin · meowmeow123ok
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing