GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo alpaca threshold90 it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 27 rafathenev2.9epochs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball R1.1 Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ML
mlfoundations dev oh v3 1 only camel math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LW
LwQ 30B Instruct
Lwq · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
oh dcft v3.1 llama 3.2 3b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.x 8b Smarteaz 0.2 R1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 11b pretrained
Llama · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama SEA LION v3 8B IT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 82 bestofn.random shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Astraea Prompt Architect Chat v10
Llama · braydenh563
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
NousResearch/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
computer 10
Computer · neuroscr
Params70.6B
Context128K
Q4_K_M42.5 GB
ZE
ZEUS 8B V30
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Locutusque/Apollo-2.0-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Openbuddy Llama3.1 70b v23.2 131k Sftonly
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 alpaca x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B BLEUBERI
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
ME
Mercury In Retrograde 8b Model Stock
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange movies
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Herrsimian 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Base
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama3.1 8B PlumChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange bitcoin
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
adi llama 3.1 8b ablit glm5.2
Llama · AdvancedDataIntelligence
Params8.03B
Context128K
Q4_K_M4.9 GB
TE
Danilas/test3
Test · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess R1 Limerick Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB