GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B Lexi Uncensored V2 Q6 K
Llama · Spaceballs
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 kartoffeldes 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Lexi Uncensored V2 apostate
Llama · Spaceballs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct
Llama · poisson-fish
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
magpielm 8b chat v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · single2332
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
ref 70 e3
Ref · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TH
L3.1 Theory of mind 8B
Theory · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mox tiny 1
Llama · vanta-research
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 Tulu 3 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stackexchange avp i1
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
New Dawn Llama 3.1 70B v1.1
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct UD OQ8 0 F32.EQ8 0 F32.IQ4 K Q8 0
Llama · Joseph717171
Params8.03B
Context128K
Smallest7.4 GB
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
calme-2.3-llama3.1-70b
Llama · NexesQuants
Params70.6B
Context128K
Smallest34.8 GB
LL
Llama Nephilim Metamorphosis v2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 K M
Llama · roleplaiapp
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
IeBoytsov llama3 1 ox llms 8b sft full 3 epochs
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Theia Llama 3.1 8B v1.1
Llama · Chainbase-Labs
Params8B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uncensored DeLMAT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
leafspark Llama 3.1 8B MultiReflection Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB