Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Selene 1 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
llama 3 neural chat v1 8b
Llama · bartowski
Params8B
Context—
Q4_K_M4.9 GB
Coding
LL
Llama 3.3 8B Character Creator V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
BlackSheep Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Herplete LLM Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SlimOrca Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct 32k
Llama · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Supernova Lite Instruct Merge Abliterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 4194k i1
Llama · mradermacher
Params8.03B
Context1K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Karamaru v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CoReward Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3 Med42 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 42b v0
Llama · mradermacher
Params43.2B
Context8K
Q4_K_M26.1 GB
GGUF
LL
Llama3.1 8b_codeio_pp
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Executor3.0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 13B LoRA Assemble
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B RedQueenGuard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
bling sheared llama 1.3b 0.1
Llama · afrideva
Params1.35B
Context4K
Q4_K_M0.9 GB
GGUF
LL
BlenderCartel Llama33 70B Pt2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Hermes 3 Llama 3.2 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
llama 3 8B function calling i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 1b
Llama · callgg
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
namespace Pt Llama 3 8B Instruct 80K QLoRA Merged
Llama · RichardErkhov
Params8.03B
Context80K
Q4_K_M4.9 GB
GGUF
LL
Pantheon RP 1.0 8b Llama 3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing