GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B Instruct RoleVerse SFT DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumMath
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · ggml-org
Params8.03B
Context128K
Smallest6.0 GB
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Jbliterated v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
ME
Meditron3 8B
Meditron · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EIRAI 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · itlwas
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
Llama 3.1 EIRAI 8B Prob i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B DPO
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Guard 3 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB