Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Admiral Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.X Workout 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Medichat Llama3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Pantheon-RP-1.0-8b-Llama-3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
Vision
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Open-Ko-8B
Llama · teddylee777
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8b Uncensored Dare i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB
GGUF
LL
yo-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · bartowski
Params8B
Context16K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Groq-70B-Tool-Use
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use

Keep browsing