GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Selene 1 Mini Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Plus Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Leashed Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 70B IT
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Japanese Yamaguchi Dialect
Llama · kg-b0mbe
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Discord Short 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
PY
PyThagorean 10B i1
Pythagorean · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Pro Coder v1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LU
luxia selfsim 8b
Luxia · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align SFT v0.2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct abliterated
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
karma electric llama31 8b
Llama · anicka
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · 0xroyce
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Cogito-V2-Preview-Llama-70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Fireball 3.1 8B ORPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · AI-Engine
Params8.03B
Context128K
Smallest3.2 GB