Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
OntoTune Sftdpo Llama3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b instruct hasanpiker abliterated i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B ContinuedTraining
Llama · ericflo
Params8.03B
Context128K
Smallest8.5 GB
Coding
LL
Llama2 MedTuned 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3 70B ShiningValiant2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Reasoning Llama 3.2 1B Instruct v1.3 i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
LL
CodeActAgent Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
.\TroyDoesAI Llama 21B
Llama · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · pingappslab
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Impish_LLAMA_4B_Abliterated
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Llama 2 7b chat hf
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.2 11B Vision Instruct
Llama · Sci-fi-vy
Params9.78B
Context128K
Q4_K_M6.0 GB
Tool useVision
LL
Llama Fin 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Cogito-V2-Preview-Llama-405B
Llama · unsloth
Params406B
Context128K
Q4_K_M243.1 GB
ReasoningTool use
LL
Llama 3.2 3B Instruct Roleplay Tuned
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
New Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-Hercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Chan Shitpost 2.5 Llama Small
Llama · mradermacher
Params9M
Context2K
Q4_K_M0.0 GB
GGUF
LL
Deepcogito.Cogito v1 Preview Llama 70B
Llama · csabakecskemeti
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3 8B Lexi Smaug Uncensored
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 MagicalGirl 2 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 3b Uncensored
Llama · Shyamnath
Params3.61B
Context128K
Smallest3.8 GB
Tool use
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing