GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3Bx4
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
GGUF
SE
RUN WITH SCISSORS 3.2 1B Q5 K M
Sentimental · Novaciano
Params1.5B
Context128K
Smallest1.1 GB
CodingReasoningRoleplay
LL
Tess-2.0-Llama-3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · tinyrao
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Meta-Llama-3-8B-Instruct
Llama · porterrigby
Params8.03B
Context8K
Q4_K_M9.8 GB
GGUF
LL
Halu 8B Llama3 v0.35
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
SU
Casual Autopsy L3 Super Nova RP 8B
Super · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Roleplay
LL
Llama3 OpenBioLLM 8B Q3 K M
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GGUF
LL
Turkish Llama 8b DPO v0.1
Llama · ufukcetinkaya
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Migtissera Llama 3 70B Synthia v3.5
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Mmnga Llama 3 70B Japanese Suzume Vector v0.1
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · sygenaithanos
Params8.03B
Context1024K
Smallest4.7 GB
GGUF
LL
Llama 3 MAAL 8B Instruct v0.1
Llama · Jaymon
Params8.03B
Context8K
Smallest8.5 GB
GGUF
NE
NeuralAirDevil 8B abliterated Airoboros trained iq4 nl imat
Neuraldaredevil · nielsijzerman
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LU
Luminatium L3 8b
Luminatium · Entropicengine
Params8.03B
Context8K
Smallest8.5 GB
GGUF
CA
CataLlama-v0.1-Instruct-SFT
Catallama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
llama3-8b
Llama · PenutChen
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-SFT-200K-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · SpencerSun
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama3-8b-lora-cc
Llama · daneggertmoeller
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct 128k
Llama · dollartw
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLMV5
Llmv · 4mrii
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Ultra-Instruct
Llama · Dampfinchen
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Genesist-8B-EarlyPrototype-0.3
Genesist · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B
Llama · kaetemi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Power-Llama-3-13b
Llama · mradermacher
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
llama3-13.45b-Instruct
Llama · win10
Params13.3B
Context8K
Smallest10.9 GB
GGUF
LU
L3 8B Lunaris v1 Q8 0
Lunaris · beebsluvr
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing