Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
MrRobotoAI llama3 8B Special Dark v3.1.2c
Llama · RichardErkhov
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Fei v1 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
French-Alpaca-Llama3-8B-Instruct-v1.0
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinirc-Llama3-8B-2G-Release-v1.0
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama Guard 2 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · bullerwins
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 3 5B Sheard
Llama · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
LL
Llama 3.3 70B o1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 8B Instruct
Llama · hermes42
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama3Ternary 2b
Llama · CMSManhattan
Params2.1B
Context8K
Q4_K_M1.3 GB
Tool use
LL
Llama3 8B 1.58 100B Tokens
Llama · brunopio
Params8B
Context8K
Smallest2.2 GB
GGUF
LL
Llama 3 portuguese Tom cat 8b instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-V41-1048k
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EIRAI 8B Prob
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
Tool useVision
LL
Prox-Llama-3-8B-abliterated
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
mar llama3.1 8B
Llama · xteapot
Params8B
Context128K
Smallest16.1 GB
Roleplay
LL
Llama 3.2 8X3B GATED MOE Reasoning Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
ReasoningRoleplay
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
h2oai h2ogpt 16k codellama 13b instruct
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M1.7 GB
Coding
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama2 Chat AYT 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Artificium llama3.1 8B 001 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing