GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 seed50
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Instruct 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b webinstruct 750k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 405B Instruct
Llama · leafspark
Params210B
Context—
Smallest71.8 GB
LL
Natsumura Assistant 1.0 Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FinR1 Llama 8b Multi Language Thinking
Llama · brodatech
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
barc0 Llama 3.1 ARC Heavy Transduction 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SLIMER PARALLEL LLaMA3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · Azerty76
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama/Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
KR
KRONOS 8B V2
Kronos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only sharegpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3.1-8B-Lexi-Uncensored-V2
Llama · zefie
Params8.03B
Context128K
Smallest6.0 GB
DO
Domestic Yak 8B
Domestic · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama 3.1 8B Instruct Heretic 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MDCure LLAMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MIST Mini 8B Thinking
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Impish_LLAMA_3B_Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo camel ai math
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 0 4 8
Llama · dabr1
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8b Dolermed V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB