GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Deepcogito.Cogito v1 Preview Llama 70B
Llama · csabakecskemeti
Params70.6B
Context128K
Q4_K_M42.5 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022 i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.24 i1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uncensored Complete
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Triangulum 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
VA
Valiant Vanta 8B Dark Fusion
Valiant · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 IgneousIguana 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
L3.1 8b RP Ink i1
Ink · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Aleph 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 10000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 gemini 1.5 pro i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
FiscalOxLLM Base
Fiscaloxllm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LW
LwQ 10B Instruct
Lwq · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
ML
mlfoundations dev stackoverflow 5000tasks .75p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · chatpig
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B Cobalt
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek llama3.1 HARI 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MU
Multiclass Think RM 8B
Multiclass · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.6
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo collective cognition
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel chemistry x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct MedQA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB