GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3 8B Instruct Q4 K M
Llama · Ru3ll
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct CycleQD CS
Llama · neody
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DevNexAI Pro1
Llama · Devnexai
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3 Groq 8B Tool Use Q4 K M
Llama · kobu2
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-8B
Llama · AI-Sweden-Models
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · janchk
Params88M
Context—
Smallest0.4 GB
GGUF
LL
Dampfinchen Llama 3.1 8B Ultra Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
lllyasviel_omost-llama-3-8b
Llama · gbueno86
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
medllama3-v20
Medllama · Johnyquest7
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Ko-Llama3-Luxia-8B
Llama · AIRider
Params8.17B
Context8K
Q4_K_M5.0 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview Q6 K
Llama · tommytracx
Params8.03B
Context128K
Smallest6.6 GB
ReasoningRoleplayTool use
LL
Llama 3 8b ita ties pro
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
LLaMA3 iterative DPO final
Llama · sirovub
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · heitong
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama 3 8B spectrum 25
Llama · yuvraj17
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
KO
L3.1 8B komorebi
Komorebi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
T Rex mini Q4 K M
Rex · BobFawkes
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
fine tune test 2
Llama · ankur1423
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3 8B Instruct
Llama · Ash-412001
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Hermes 3 Llama 3.2 3B Q4 0
Llama · PJRM
Params3.21B
Context128K
Smallest1.9 GB
RoleplayTool use
LL
Llama-3-8B-Instruct-DPO-v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
llama3 int8wo
Llama · jerryzh168
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Thoth Warding Llama 3B IQ5 K S
Llama · IntelligentEstate
Params3.21B
Context128K
Smallest2.3 GB
RoleplayTool use
LL
SFR Iterative DPO LLaMA 3 8B R
Llama · sirovub
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
Meta Llama 3 8B
Llama · JohnConnor123
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · yh-yao
Params8.03B
Context8K
Smallest3.7 GB
GGUF
HO
HOTHUN Hermes 3 8B v1.2
Hothun · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DO
Dolphin3 Cyber 8B
Dolphin · Cybereques
Params8.03B
Context128K
Smallest6.6 GB
GGUF
TS
tsavage68 IE L3 150steps 1e7rate 01beta cSFTDPO
Tsavage · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing