Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Selene 1 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama 3 neural chat v1 8b
Llama · bartowski
Params8B
Context—
Q4_K_M4.9 GB
LL
Llama 3.3 8B Character Creator V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BlackSheep Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Herplete LLM Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SlimOrca Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct 32k
Llama · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
Llama 3.1 Supernova Lite Instruct Merge Abliterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Gradient 4194k i1
Llama · mradermacher
Params8.03B
Context1K
Q4_K_M4.9 GB
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Karamaru v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CoReward Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 Med42 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 42b v0
Llama · mradermacher
Params43.2B
Context8K
Q4_K_M26.1 GB
LL
Llama3.1 8b_codeio_pp
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Executor3.0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 13B LoRA Assemble
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 8B RedQueenGuard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
bling sheared llama 1.3b 0.1
Llama · afrideva
Params1.35B
Context4K
Q4_K_M0.9 GB
LL
BlenderCartel Llama33 70B Pt2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.2 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama 3 8B function calling i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1b
Llama · callgg
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
namespace Pt Llama 3 8B Instruct 80K QLoRA Merged
Llama · RichardErkhov
Params8.03B
Context80K
Q4_K_M4.9 GB
LL
Pantheon RP 1.0 8b Llama 3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB