GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Amelia ACC 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ruliad.deepthought 8b llama v0.01 alpha
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
bella bartender v2 8b
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Liberalis Cogitator Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 natural farmer 16bit
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev hp ablations llama3 epoch1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mylesgoose/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Ablation 131 Geniac.Gbs128.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama Carvalho PT GL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VI
Vivian12300 middle ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Fireplace2
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
Tool use
NE
NeuralDaredevil SuperNova Lite 7B DARETIES abliterated
Neuraldaredevil · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 1B abliterated i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
athirdpath Llama 3.1 Base NSFW pretrained e 0.5
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BioMed R1 8B
Biomed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CH
chrisnic Python Ass
Chrisnic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OU
oumi l8b ultrachat
Oumi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Amelia SD 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Cogito v1 Preview Llama 8B
Llama · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3 1 8b mlfoundations dev stackexchange scicomp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Natsumura Llama3.1 v1.0 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
Megatron
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
LL
grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
aifeifei799 Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · RichardErkhov
Params4.17B
Context128K
Q4_K_M2.6 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · 3Simplex
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
ContaLLM Food Beverage 8B Instruct
Contallm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing