Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
FinChat298B Llama 3.1 8Bi i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Progenitor R1 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama 3 Taiwan 70B Instruct Rc3
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Swallow 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama 3.2 3B Instruct roleplay tuned
Llama · Indexnusrefather
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
Llama-3-Mopeyfied-Psychology-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Unsafe Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 ReRank YesNo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Embedding
LL
Llama Guard 3 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
llama-3-8b-it-ko-chang
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Magpie SFT Mix 800KMT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA-3-8B-Instruct-Abliterated-TR
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA-3-8B-Instruct-Abliterated-TR
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.3 70B CogniLink i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
nvidia_Llama 3.1 Nemotron 8B UltraLong 1M Instruct Abliterated
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Middo Wizard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
openPangu 2.0 Flash
Llama · ji-farthing
Params100B
Context512K
Q4_K_M60.9 GB
ReasoningTool use
LL
vdr 2b multi v1 i1
Llama · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
LL
Meta Llama 3.1 8B Claude i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-ELYZA-JP-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama JoyCaption Alpha Two
Llama · Jobaar
Params8.03B
Context128K
Smallest6.6 GB
Tool useVision
LL
IDK AP WMDP llama3 8b instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Chat 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Code-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 4 Scout 17B 16E Instruct Abliterated v2
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
Vision
LL
Llama 3.3 70B Vulpecula R1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3.1 8B ReMaRk RedditV2 SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CodeLlama 7B KStack Clean
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Pars Medical O1 Llama FFT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use

Keep browsing