Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Infinity Instruct 7M 0729 Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Chat Summary 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
LlamaThink 8B Instruct
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Mantella Skyrim Llama 3 8B Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 3B
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama-3-8B-Ultrachat-200K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningRoleplayTool use
LL
OpenBioLLM-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ELYZA japanese CodeLlama 7b instruct
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
llama3-8B-DarkIdol-1.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-8B-Instruct-abliterated-dpomix
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2 13B Erebus v3
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ArliAI Llama 3 8B Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Asclepius Llama2 13B Pretraining Only
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Joah-Remix-Llama-3-KoEn-8B-Reborn
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3_70_b_uncensored_continued
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-Umbral-Mind-Replete-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Reflector Internalizing Safety Llama 3.1 8B RL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Pro Coder v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Bioinspired Llama 3 1 8B 128k gamma i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
OneLLM Doey V1 Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
TopicalStorm Llama3.1 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.3 8B Instruct Thinking Heretic Uncensored Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Deepcogito.Cogito v1 Preview Llama 3B
Llama · DevQuasar-13
Params3.61B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
LL
Llama-3-ELYZA-JP-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Pruned 6 Layers
Llama · mradermacher
Params6.5B
Context128K
Q4_K_M4.0 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
scandukuri llama3 8b stargate m1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing