Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Text to Sql llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dobby Mini Unhinged Plus Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Dobby Mini Leashed Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Chinese Llama 2 7B
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct CODE Python English Asistant 16bit v2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 7b Hf
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 8B Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7B KStack Clean
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3 70B IT
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Bioinspired Base Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool useVision
LL
Linkbricks-Horizon-AI-Ko-llama3-Instruct-dpo-8B-base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 8B Japanese Yamaguchi Dialect
Llama · kg-b0mbe
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3 8b Instruct kamal treeofthoughts game24
Llama · Kamalu211
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
rombos Llama3 8B Instruct Replete Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 Discord Short 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dobby Unhinged Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Boundary Meta Llama 3 2x8B MoE
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 DarkStorm Aspire 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
shisa v2.1 llama3.3 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
LLaMA Mesh
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing