Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
MrRobotoAI llama3 8B Special Dark v3.1.2c
Llama · RichardErkhov
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
French-Alpaca-Llama3-8B-Instruct-v1.0
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
Infinirc-Llama3-8B-2G-Release-v1.0
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama Guard 2 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 405B Instruct
Llama · bullerwins
Params410B
Context128K
Q4_K_M245.7 GB
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3 5B Sheard
Llama · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
LL
Llama 3.3 70B o1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Instruct
Llama · hermes42
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3Ternary 2b
Llama · CMSManhattan
Params2.1B
Context8K
Q4_K_M1.3 GB
LL
Llama3 8B 1.58 100B Tokens
Llama · brunopio
Params8B
Context8K
Smallest2.2 GB
LL
Llama 3 portuguese Tom cat 8b instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-V41-1048k
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Llama 3.1 EIRAI 8B Prob
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
LL
Prox-Llama-3-8B-abliterated
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
mar llama3.1 8B
Llama · xteapot
Params8B
Context128K
Smallest16.1 GB
LL
Llama 3.2 8X3B GATED MOE Reasoning Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
h2oai h2ogpt 16k codellama 13b instruct
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M1.7 GB
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama2 Chat AYT 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Artificium llama3.1 8B 001 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB