GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Minitron 4B Width Base
Llama · l3utterfly
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · xyottax
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · JanneDoe
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OpenHermes 2.5 sedrick
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 8B MTP
Llama · Rapnss
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct HSE AI Hack tuned Q8 0
Llama · srnm
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Ablation 98 Bestofn.Atlo.Rp.Tl.Geniac Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Ablation 126 Shisav2.Gbs128.8E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Alpaca Llama3.1 8B
Llama · EpistemeAI
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
AtlaAI.Selene 1 Mini Llama 3.1 8B
Llama · DevQuasar-4
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
BA
barc0 100k transduction gpt4omini lr1e 5 epoch3 engineering
Barc · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ST
stackexchange literature
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · Fallen03
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Tortoise
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMA Mesh
Llama · trackdr
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Dark Enigma
Llama · agentlans
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
MFANN llama3.1 abliterated SLERP v3.1 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 23 rafbestseqshuffle.2epoch shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · xyottax
Params8.03B
Context128K
Smallest3.7 GB
GGUF
LL
Llama 3.1 8B
Llama · NbAiLab
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · lemon-mint
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stackoverflow 25000tasks 1p
Stackoverflow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Shariar076 Llama 3.1 8B Instruct DPO 0R100L PoliTune
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
Tool use
FR
FractalSoup L3 8b
Fractalsoup · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · NonMiFrega
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing