GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B MultiReflection Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
deepthought 8b llama v0.01 alpha
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DO
Dolphin3 Cyber 8B
Dolphin · ScottzillaSystems
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8b Instruct
Llama · ilsp
Params8.2B
Context128K
Q4_K_M5.0 GB
FI
Fino1 8B
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Cogito v1 Preview Llama 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
WR
Wraith 8b
Wraith · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · Spaceballs
Params8B
Context128K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Calix CLM 1.0
Llama · calix-ai-labs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · DevQuasar-7
Params8B
Context128K
Q4_K_M4.9 GB