GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BatsResearch Llama 3.1 8B bonito v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instuct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
MagpieLM 8B Chat v0.1
Magpielm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta llama_Meta Llama 3.1 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Theia Llama 3.1 8B v1
Llama · Chainbase-Labs
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 250801
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Assistant_Pepe_8B
Assistant · bartowski
Params8.04B
Context1048K
Q4_K_M4.9 GB
GG
GGUFDumps
Ggufdumps · koboldcpp
Params20.1B
Context128K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3.1-8B-bnb-4bit
Llama · chatpdflocal
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 10000tasks 0p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
FinR1 Llama 8b Multi Language Thinking
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
LLaMA 3.1 Turkis 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Magpie Align v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Unhinged Vision 8B
Llama · FiditeNemini
Params8.03B
Context8K
Smallest8.5 GB
LL
Sparse Llama 3.1 8B 2of4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB