GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ST
stackexchange history
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q3 K L
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
PI
L3.1 8B Pippa OwO RP
Pippa · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
New Dawn Llama3.1 70b v1.1
Llama · RichardErkhov
Params70.6B
Context128K
Smallest26.4 GB
LL
llama 3.1 8B Instruct abliterated comrade
Llama · Aratron1811
Params8.03B
Context128K
Smallest3.9 GB
LL
NousResearch/Meta-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama3.1 indoprog
Llama · akmalfairuz
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Amoral Cogito v1 Preview Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
barc0 Llama 3.1 ARC Potpourri Induction 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 8B Distill CoT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama PLLuM 8B Chat
Llama · tsej
Params8.03B
Context128K
Smallest4.7 GB
AS
Aspire V4 8B Model Stock
Aspire · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.1 nemotron 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange emacs
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 18 rafbestseq shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
llama3.1 typhoon2 deepseek r1 70b
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MF
MFANNv0.24
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DoberWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama 3.1 8B Instruct
Llama · CelesteImperia
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 2508
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolermed R1 V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 IgneousIguana 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 typhoon2 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 ARC Heavy Induction 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumMath
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball Meta Llama 3.1 8B Instruct Agent 0.003 128K Code Ds
Llama · legolasyiu
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama Krikri 8B Instruct
Llama · AlexKarap
Params8.2B
Context128K
Q4_K_M5.0 GB