GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 70B Instruct
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
aifeifei798/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stackexchange movies
Stackexchange · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
SL
oh v1.3 slim orca x8
Slim · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.1
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
Tulu 3.69 8B
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BadApple O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
pansophic/pansophic-1-preview-LLaMA3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 LexiHermes SuperStorm
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AXCXEPT/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Allades 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
VA
Valiant Vanta 8B Dark Fusion
Valiant · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
BigTalker Lite 8B i1
Bigtalker · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia Llama 3.1 Nemotron 70B Instruct HF
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
Binary Think RM 8B
Binary · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev.oh dcft v3.1 claude 3 5 haiku 20241022
Mlfoundations · DevQuasar-8
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b instruct LLMPC Blue Team
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KISTI KONI KONI Llama3.1 8B Instruct 20241024
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 10B Instruct
Llama · mradermacher
Params9.99B
Context128K
Q4_K_M6.1 GB
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fiendish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Sparse Llama 3.1 8B 2of4
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Turkish Llama 3.1 8B Instruct
Llama · mehmettozlu
Params8.03B
Context128K
Q4_K_M4.9 GB