GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta-Llama-3-8B-Instruct
Llama · ddh0
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
lighteternal Llama 3 8B Instruct MergeSLERP Gradient1048k OpenBioLLM
Llama · RichardErkhov
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Awanllm-Llama-3-8B-Dolfin-v0.5
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · vsevolodl
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
ibivibiv llama 3 nectar dpo 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningRoleplayTool use
LL
Llama-Salad-8x8B
Llama · mradermacher
Params47.5B
Context8K
Q4_K_M29.0 GB
GGUF
BA
BanglaLLM BanglaLLama 3 8b BnWiki Base
Banglallm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
RoleplayTool use
LL
Trendyol LLM 8b Chat v2.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B DarkIdol 1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-70B-Instruct-Gradient-262k
Llama · LoneStriker
Params70.6B
Context256K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · keisuke-miyako
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · victorbur
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
LL
Llama-3-ELYZA-hermes-2x8B
Llama · keitokei1994
Params13.7B
Context8K
Q4_K_M8.3 GB
Tool use
LL
Llama 3 Deita 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Jimmy19991222 llama 3 8b instruct gapo v2 rouge2 beta10 gamma0.3 lr1.0e 6 scale log
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
klcsp llama3.1 8b gpt4o 100k summarize fft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 8b baseline dcft oh v3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nyun-c1-llama3-60B
Llama · mradermacher
Params60.3B
Context8K
Q4_K_M36.3 GB
GGUF
LL
llama3 8B slerp biomed chat chinese
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
yentinglin/Llama-3-Taiwan-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KO
L3.1 8B komorebi
Komorebi · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 01 liger shisa v2 llama3 8b lr8e6
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tesser-ai/Tesser-Llama-3-Ko-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-instruct
Llama · AI-Sweden-Models
Params8.03B
Context8K
Smallest4.0 GB
GGUF
LL
Llama-3-Umievo-Shizuko-sqlcoder-2x8B
Llama · keitokei1994
Params13.7B
Context8K
Q4_K_M8.3 GB
Coding
LL
Henrychur MMed Llama 3 8B EnIns
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama3 ChatQA 1.5 8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF

Keep browsing