GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Leonida Beta
Llama · jgchaparro
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
DC
oh dcft v3.1 gpt 4o 2024 11 20
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo evolinstruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TU
Tulu Tree Fiddy 8B
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ML
mlfoundations dev oh v3 1 only camel biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Mlx
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
netcat420/MFANN-llama3.1-abliterated-SLERP-v3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QU
Question_Builder_Abliterated
Question · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo platypus
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 2 13b chat PolicyPro i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Kawaiides llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
simonycl llama 3.1 8b instruct ultrafeedback armorm
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Orenguteng.Llama 3.1 8B Lexi Uncensored V2
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
lambda llama 3 8b ipo test
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Medusa v1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only camel chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
DongfuJiang prm gsm 2k with full sol mix ref remove all correct hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AD
Adversary 8B v1.1
Adversary · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
LL
mlfoundations dev llama3 1 8b oh v3.1 wo camel ai biology
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only evol instruct 140k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo camel ai biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflector Internalizing Safety Llama 3.1 8B RL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh dcft v1 no curation
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Enigma
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
ML
mlfoundations dev oh v1 w v3 camel math gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1 2 only camel math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Infinirc 8B Instruct
Llama · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
VI
Vivian12300 en sw
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Fusion 9010
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing