GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · antoste
Params8.03B
Context128K
Smallest3.8 GB
LL
Deepcogito Cogito v1 Preview Llama 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · HeRksTAn
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
Dolphin X1 8B
Dolphin · ling1000T
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · kkwagh999
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange philosophy
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange or
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Metabolic Llama V1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
mergekit model stock zengbax
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
lora Meta Llama 3.1 8B Instruct
Llama · weber50432
Params8.03B
Context128K
Smallest16.1 GB
LL
llama 3.1 8b conservative christian worldview 10k pairs
Llama · sarileyman
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Function Calling Agent
Llama · Berhak
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
Vivian12300 bottom ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reasoning Llama 3.1 CoT RE1 i1 IQ3 M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.8 GB
LL
Meta Llama 3.1 70B Instruct
Llama · Isvara
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 70b Cpt Sea Lionv3 Base
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
fabricator
Llama · redcathode
Params21M
Context—
Smallest0.1 GB
LL
reflection llama 3.1 8B Solshine trainround3 16bit Q4 K M
Llama · Solshine
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 8b instruct 07 24
Llama · xaskasdf
Params8.03B
Context128K
Smallest2.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · adonald
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 8B
Llama · NbAiLab
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest4.7 GB
ST
stackexchange webapps
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Q8 0
Llama · SYNERDATA
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · Recouper
Params8.03B
Context128K
Q4_K_M4.9 GB