Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 MOE 4X8B Gated IQ Multi Tier Deep Reasoning 32B
Llama · DavidAU
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplayTool use
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 3 Open Ko 8B
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama cpp python wheels
Llama · amukhinfly
Params3.09B
Context32K
Smallest3.3 GB
Tool use
LL
Llama 3.1 Tulu 3 8B DPO
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
FuseChat Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.3 70B Instruct Abliterated GGUF ARMADO
Llama · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
llama3 42b v0 iMat
Llama · InferenceIllusionist
Params43.2B
Context8K
Q4_K_M26.1 GB
GGUF
LL
Llama 3 Open Ko 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama MagicalGirl i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Hermes-2-Theta-Llama-3-8B
Llama · thesven
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Claude iMat
Llama · InferenceIllusionist
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Cogito-V2-Preview-Llama-109B-Moe
Llama · unsloth
Params108B
Context256K
Q4_K_M65.4 GB
Vision
LL
TransLLaMA2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
llama polyglot 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · NousResearch
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Llama Guard 3 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Agente Llama 3.1 Asistant 16bit v2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Evolved Llama3 8B
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
MultiPL-T-CodeLlama_34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 3 ChocoLlama 8B instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
codellama CodeLlama 13b Python hf
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
Coding
LL
Llama 3 8b Dolphin Uncensored
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing