GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
aifeifei798/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ST
stackexchange movies
Stackexchange · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
SL
oh v1.3 slim orca x8
Slim · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.1
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TU
Tulu 3.69 8B
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
BadApple O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
pansophic/pansophic-1-preview-LLaMA3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.1 LexiHermes SuperStorm
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
AXCXEPT/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 Allades 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
VA
Valiant Vanta 8B Dark Fusion
Valiant · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BigTalker Lite 8B i1
Bigtalker · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nvidia Llama 3.1 Nemotron 70B Instruct HF
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BI
Binary Think RM 8B
Binary · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
ML
mlfoundations dev.oh dcft v3.1 claude 3 5 haiku 20241022
Mlfoundations · DevQuasar-8
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b instruct LLMPC Blue Team
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KISTI KONI KONI Llama3.1 8B Instruct 20241024
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 10B Instruct
Llama · mradermacher
Params9.99B
Context128K
Q4_K_M6.1 GB
Tool use
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Fiendish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Sparse Llama 3.1 8B 2of4
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 3.1 8B Instruct
Llama · mehmettozlu
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing