Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
FinChat298B Llama 3.1 8Bi i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Progenitor R1 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Taiwan 70B Instruct Rc3
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 Swallow 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
DeepHermes 3 Llama 3 8B Preview Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct roleplay tuned
Llama · Indexnusrefather
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama-3-Mopeyfied-Psychology-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Unsafe Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 ReRank YesNo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Guard 3 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
llama-3-8b-it-ko-chang
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie SFT Mix 800KMT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA-3-8B-Instruct-Abliterated-TR
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMA-3-8B-Instruct-Abliterated-TR
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.3 70B CogniLink i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia_Llama 3.1 Nemotron 8B UltraLong 1M Instruct Abliterated
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
LL
Llama3.1 8B Middo Wizard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
openPangu 2.0 Flash
Llama · ji-farthing
Params100B
Context512K
Q4_K_M60.9 GB
LL
vdr 2b multi v1 i1
Llama · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Meta Llama 3.1 8B Claude i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-ELYZA-JP-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama JoyCaption Alpha Two
Llama · Jobaar
Params8.03B
Context128K
Smallest6.6 GB
LL
IDK AP WMDP llama3 8b instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Chat 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Code-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 4 Scout 17B 16E Instruct Abliterated v2
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
LL
Llama 3.3 70B Vulpecula R1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ReMaRk RedditV2 SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 7B KStack Clean
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Pars Medical O1 Llama FFT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB