GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Minitron 4B Width Base
Llama · l3utterfly
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Meta Llama 3.1 8B
Llama · xyottax
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · JanneDoe
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OpenHermes 2.5 sedrick
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 8B MTP
Llama · Rapnss
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct HSE AI Hack tuned Q8 0
Llama · srnm
Params8.03B
Context128K
Smallest8.5 GB
LL
Ablation 98 Bestofn.Atlo.Rp.Tl.Geniac Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 126 Shisav2.Gbs128.8E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Alpaca Llama3.1 8B
Llama · EpistemeAI
Params8.03B
Context128K
Smallest16.1 GB
LL
Llama 3.1 8b DoberWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
AtlaAI.Selene 1 Mini Llama 3.1 8B
Llama · DevQuasar-4
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
BA
barc0 100k transduction gpt4omini lr1e 5 epoch3 engineering
Barc · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ST
stackexchange literature
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3.1 8B Chinese Chat
Llama · Fallen03
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 8B Tortoise
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · trackdr
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Dark Enigma
Llama · agentlans
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 23 rafbestseqshuffle.2epoch shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · xyottax
Params8.03B
Context128K
Smallest3.7 GB
LL
Llama 3.1 8B
Llama · NbAiLab
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · lemon-mint
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
stackoverflow 25000tasks 1p
Stackoverflow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Shariar076 Llama 3.1 8B Instruct DPO 0R100L PoliTune
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
FR
FractalSoup L3 8b
Fractalsoup · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B Cobalt
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · NonMiFrega
Params8.03B
Context128K
Q4_K_M4.9 GB