Llama GGUF models

30022 GGUF models in the Llama family, quantized by 7347 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
LL
SageV2 8B LongContext NSFW RP
Llama · sinhal
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
LL
ultravox v0 5 llama 3 2 1b
Llama · ggml-org
Params1.24B
Context128K
Q4_K_M0.8 GB
Vision
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama3.1-8B-Chinese-Chat
Llama · shenzhi-wang
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · hugging-quants
Params1.24B
Context128K
Smallest1.3 GB
GGUF
LL
turboderp Cat Llama 3 70B instruct
Llama · RichardErkhov
Params3.3B
Context—
Q4_K_M0.0 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-imatrix
Llama · lmstudio-community
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 4X3B MOE Hell California Uncensored 10B
Llama · DavidAU
Params9.95B
Context128K
Q4_K_M6.1 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct
Llama · modularai
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-ELYZA-JP-8B
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 1b
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
LL
LLaMA2 13B Tiefighter
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
MiniCPM Llama3 V 2 5
Llama · openbmb
Params8.2B
Context8K
Q4_K_M4.9 GB
Vision
LL
FILM6912 Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
GGUF
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
LL
tap-m_luna-ai-llama2-uncensored
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
codellama_codellama-34b-python-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
llama3.1 airoboros3.2 QDT 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
4 alokk llama 3 8b English to Hinglish
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · dphn
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Ostrich 70B
Llama · some1nostr
Params70.6B
Context8K
Smallest34.3 GB
GGUF
LL
dolphin-llama3-zh-cn-uncensored
Llama · stephenlzc
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing