GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
MF
MFANNv0.24 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama3.1 MFANN 8b Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 Tulu 3 8B DPO Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Llama abadalabs hectron
Gemma · hectorruiz9
Params—
Context—
Smallest0.0 GB
AI
AIGF
Aigf · se1250
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · ggbetz
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · kabriel
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlabonne Llama 3.1 70B Instruct lorablated bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama PLLuM 8B Instruct
Llama · tsej
Params8.03B
Context128K
Smallest4.7 GB
LL
Reasoning Llama 3.1 CoT RE1 i1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B Instruct
Llama · snefrika
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · ipropel
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · qqqq-hf
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
pllum 8b instruct q5 k m
Llama · pswitala
Params8.03B
Context128K
Smallest5.7 GB
LL
Cogito v1 Preview Llama 8B
Llama · ankandrew
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 8B instruct
Llama · SandraJ
Params8.03B
Context128K
Smallest4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · molipedia
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Defne llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · BrassLion
Params8.03B
Context128K
Smallest4.3 GB
LL
Llama 3.1 70B LatamGPT SFT 1.0 IQ2 S
Llama · pabloreyespo
Params70.6B
Context4K
Smallest22.2 GB
TU
turkishSentenceGenerater
Turkishsentencegenerater · yunus111
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3.1 leave out non v1.2 subsets
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · jitsi
Params8.03B
Context128K
Smallest8.5 GB
NE
L3.1 nemotron sunfall v0.7.0 q4 k m
Nemotron · crestf411
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Openbuddy Llama3.1 70b v23.1 131k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · wishgoods
Params8.03B
Context128K
Smallest4.0 GB
LL
Llama 3.1 8B Instruct
Llama · shaileshsarda
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B Instruct
Llama · ShinnningPikachu
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama3.1 8B Chinese Chat
Llama · jimmylam6666
Params8.03B
Context128K
Smallest8.5 GB