Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llama-3-8B-rpg-v4
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DevsDoCode LLama 3 8b Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-MagPO
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-oztfijl
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Llama Poro 2 8B Long Base
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
LlamaCorn 1.1B Chat
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
LL
Laravel 11 Llama 3.2 1B Instruct
Llama · yannelli
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
LL
Llama3.2 3B Esper2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Unichat llama3 Chinese 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Evolved Llama3 8B
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Codepy Deepthink 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingReasoningTool use
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B Ultra Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLama 3.1 8B Matrix i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3-ChatQA-1.5-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dirty Alice RP NSFW Llama 3.2 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LL
cognitivecomputations dolphin 2.9.1 llama 3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Web
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
MathCoder2 CodeLlama 7B
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.2 8B GGUF 200K
Llama · prithivMLmods
Params8B
Context128K
Smallest16.1 GB
GGUF
LL
Meta llama.Llama 4 Scout 17B 16E Instruct
Llama · DevQuasar-12
Params108B
Context10240K
Q4_K_M65.4 GB
Tool use

Keep browsing