GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Swallow 70B v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · ApolloRaines
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
BRAG Llama 3.1 8b v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AD
Adversary 8B v1.1
Adversary · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
ZE
ZEUS 8B V22 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DC
oh dcft v3.1 claude 3 5 sonnet 20241022
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Discord Short 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Tulu 3 70B SFT
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama PLLuM 70B Chat 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
LlamaScientific 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 8B DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
ContaLLM Beauty 8B Instruct
Contallm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
NeuralDaredevil SuperNova Lite 7B DARETIES abliterated i1
Neuraldaredevil · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PN
L3.1 Pneuma 8B 0429
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 70B Instruct 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Fireball R1 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
BL
Blaze 14B xElite
Blaze · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LL
Llama 3.1 EstLLM 8B 0525
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Danoia
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Cobalt
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BioMed R1 32B
Biomed · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use

Keep browsing