GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · SanctumAI
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Guard 3 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
DO
Dolphin X1 8B
Dolphin · dphn
Params8B
Context128K
Q4_K_M4.9 GB
QI
QiMing Holos Plus 8B
Qiming · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LlamaScientific 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 8B
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MA
MagpieLM 8B Chat v0.1 i1
Magpielm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · yaneivan
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
CA
calme-2.3-legalkit-8b
Calme · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MO
Mox Tiny 1
Mox · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Meta llama_Meta Llama 3.1 8B Instruct
Llama · ThomasBaruzier
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DO
Dolphin3 Cyber 8B
Dolphin · meowmeow123ok
Params8B
Context128K
Q4_K_M4.9 GB