GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
dolphin 2.9.4 llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · HiddenViper229
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
SE
SelfCite 8B CC SFT i1
Selfcite · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DO
Dolphin Email 8b
Dolphin · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
allenai Llama 3.1 Tulu 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CE
L3.1 8B Celeste V1.5
Celeste · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct Jbliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama SEA LION v3 8B IT Magic_decensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev stackoverflow 5000tasks 0p
Mlfoundations · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b Cpt Sea Lionv3 Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · GPT4All-Community
Params8B
Context128K
Smallest4.7 GB
LL
HARC Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
MIST Mini 8B
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 405B Instruct
Llama · bullerwins
Params410B
Context128K
Q4_K_M245.7 GB
FI
Fireball 3.1 8B ORPO
Fireball · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EIRAI 8B Prob
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 8B
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB