GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
ablation 11 rafathenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
behbudiy/Llama-3.1-8B-Instuct-Uz
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
Fino1 8B Uncensored DeLMAT
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev.OH DCFT V3 wo sharegpt
Mlfoundations · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70b
Llama · afg1
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
ST
stackexchange cooking
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo camel ai chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Darkrazgriz88
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Base 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stackexchange musicfans
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange genealogy
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct
Llama · AntraxSS
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Blasphemer
Llama · sunkencity
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 8B R
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Mahou 1.5 llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ERP WHW
Llama · hanzag
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
nicoboss.Hermes 3 Llama 3.1 405B Uncensored
Llama · DevQuasar-14
Params406B
Context128K
Smallest149.3 GB
ML
mlfoundations dev oh v1 2 only opengpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · sdalemorrey
Params8.03B
Context128K
Q4_K_M4.9 GB
AN
L3.1 8B Animus V12.2
Animus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Crystalcareai/meta-llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
L3.1 Moe 4x8B v0.1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
VI
Vivian12300 full ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nongfuyulang engineer heavy 500k barc llama3.1 8b ins fft induction lr1e 5 epoch3 1122
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Llama 3.1 8B Instruct
Llama · croswil
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Krikri Cypriot 8B v0.1
Llama · themetron
Params8.2B
Context128K
Q4_K_M5.0 GB