GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Amelia ACC 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ruliad.deepthought 8b llama v0.01 alpha
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
bella bartender v2 8b
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Liberalis Cogitator Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 natural farmer 16bit
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mylesgoose/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 131 Geniac.Gbs128.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Carvalho PT GL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
Vivian12300 middle ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Fireplace2
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
NE
NeuralDaredevil SuperNova Lite 7B DARETIES abliterated
Neuraldaredevil · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 1B abliterated i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
athirdpath Llama 3.1 Base NSFW pretrained e 0.5
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
BioMed R1 8B
Biomed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
chrisnic Python Ass
Chrisnic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OU
oumi l8b ultrachat
Oumi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia SD 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cogito v1 Preview Llama 8B
Llama · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 8b mlfoundations dev stackexchange scicomp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Llama3.1 v1.0 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Megatron
Megatron · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
aifeifei799 Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · RichardErkhov
Params4.17B
Context128K
Q4_K_M2.6 GB
LL
Meta Llama 3.1 8B Instruct
Llama · 3Simplex
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
ContaLLM Food Beverage 8B Instruct
Contallm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB