Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Admiral Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.X Workout 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Medichat Llama3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Pantheon-RP-1.0-8b-Llama-3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Open-Ko-8B
Llama · teddylee777
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8b Uncensored Dare i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB
LL
yo-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · bartowski
Params8B
Context16K
Q4_K_M4.9 GB
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB