GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8b DoberWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Magpie Align Llama 3.1 8B Magpie Align v0.1
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ME
Mercury In Retrograde ALT 8b Model Stock i1
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Sparse Llama 3.1 8B 2of4
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
LongWriter Llama3.1 8B Absolute Heresy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
rombodawg/Meta-Llama-3.1-8B-Instruct-reuploaded
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
PN
L3.1 Pneuma 8B
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only gpt4 llm
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TI
L3.1 Tivir v0.1 10B
Tivir · mradermacher
Params10.6B
Context128K
Q4_K_M6.5 GB
LL
Llama3.1 8B MegaScience
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo cot alpaca
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 133 Geniac.Gbs128.8E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo dataforge economics
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · NightFuryTimo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
allenai.Llama 3.1 Tulu 3 405B
Llama · DevQuasar-7
Params406B
Context128K
Q4_K_M243.1 GB
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
BA
barc0 transduction run6 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B
Llama · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
IM
Impish_Mind_8B
Impish · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Medusa v1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
DS Distilled Hermes Llama 3.1 TIES
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm gsm 2k with full sol mix ref error only hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo platypus
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
barc0 transduction run7 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · fluidapp
Params8.03B
Context128K
Smallest4.4 GB
LL
HODACHI/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB