Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-8B-Instruct-UltraDPO3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b instruct LLMPC Red Team
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · redponike
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Ziya Llama 13b Medical Merged
Llama · mradermacher
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Malediction V3 LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Barcenas Llama3 8b ORPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-Nemotron-Nano-8B-v1
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
Tool use
LL
Llama 3.1 Hawkish 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.2 TaiPhone 3B Instruct v0.2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.3 8B Instruct OmniWriter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-8B-Irene-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-7B-28Layers
Llama · mradermacher
Params7.16B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Swallow Infused R1776 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
EVA LLaMA 3.33 70B v0.0 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
MO MODEL Fused Unhinged RP Alpha V2 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
dolphin 2.9 llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMAX2 7B XNLI
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Kei Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ShiningValiantXS
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
GGUF
LL
CodeLlama 7B KStack
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Roleplay Unhinged Base V1 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
GGUF
LL
Llama 3 3 Nemotron Super 49B v1 5 lecore
Llama · staccs
Params49.9B
Context128K
Q4_K_M30.2 GB
ReasoningTool use
LL
Llama 3.1 EstLLM 8B Instruct 1125
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LlamaThink 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing