GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 seed50
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 8B Instruct 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b webinstruct 750k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · leafspark
Params210B
Context—
Smallest71.8 GB
GGUF
LL
Natsumura Assistant 1.0 Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
FinR1 Llama 8b Multi Language Thinking
Llama · brodatech
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
barc0 Llama 3.1 ARC Heavy Transduction 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SLIMER PARALLEL LLaMA3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored
Llama · Azerty76
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1 w v3 unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
KR
KRONOS 8B V2
Kronos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v3 1 only sharegpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-8B-Lexi-Uncensored-V2
Llama · zefie
Params8.03B
Context128K
Smallest6.0 GB
Tool use
DO
Domestic Yak 8B
Domestic · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Impish_LLAMA_4B_Abliterated
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
MDCure LLAMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MIST Mini 8B Thinking
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Impish_LLAMA_3B_Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo camel ai math
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 0 4 8
Llama · dabr1
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8b Dolermed V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF

Keep browsing