GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Failspy Meta Llama 3 70B Instruct Abliterated v3.5
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Llama3.1 ArrowSE v0.4
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
HE
Hermes-4-70B
Hermes · Bluerosesbutterfly
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
llama3 QA
Llama · Menghuan1918
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LL
Llama-3-8B-UltraMedical
Llama · legionarius
Params8.03B
Context8K
Smallest6.6 GB
GGUF
ST
SthenoBu8bl3-32K
Sthenobu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B
Llama · eric-musa
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · Axcel1
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LL
Llama3 8B
Llama · Solshine
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8b cpt sahabatai v1 instruct
Llama · fritzwijaya
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 verus revision 2
Llama · VerusCommunity
Params8.03B
Context8K
Smallest8.5 GB
Vision
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
OwenArli ArliAI Llama 3 8B Dolfin v0.5
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama3-German-8B
Llama · beansandbytes
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · 404-OS
Params70.6B
Context8K
Smallest16.8 GB
GGUF
LL
cstr llama3.1 8b spaetzle v74
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
llama 3.1 8b pruned taylor30 smooth quant mpq
Llama · annus-lums
Params6.34B
Context128K
Smallest5.9 GB
Tool use
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · kpkiosk66
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · pabloce
Params70.6B
Context8K
Smallest34.3 GB
GGUF
CH
ChaoticSoliloquy-4x8B
Chaoticsoliloquy · delijoe
Params24.9B
Context8K
Smallest12.1 GB
GGUF
LL
WDKT Xiangxin 2XL Chat 1048k Chinese Llama3 70B
Llama · tensorblock
Params70.6B
Context1024K
Smallest26.4 GB
GGUF
LL
dream catcher llama3
Llama · MisterHolmes44
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
jcmei SELM Llama 3 8B Instruct iter 1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 monika ddlc 11.5b v1 i1 Q3 K M
Llama · roleplaiapp
Params11.5B
Context8K
Smallest5.7 GB
GGUF
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · cansa
Params8.03B
Context8K
Smallest5.6 GB
GGUF
ET
Ethereal Rainbow v0.1 11B
Ethereal · SzilviaB
Params11.1B
Context8K
Smallest7.9 GB
GGUF
LL
Llama 3 Karamaru v1 gguf q4 k m
Llama · keisuke-miyako
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-13.45b-Instruct
Llama · win10
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
llama 3 8b Instruct bnb 4bit aiaustin demo unsloth.Q4 K M
Llama · BurakKarakurt
Params13M
Context—
Q4_K_M0.0 GB
GGUF
LL
Llama-3-8B
Llama · AI-Sweden-Models
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing