Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 8b Ita
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
4yo1 llama3 eng ko 8 llama
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.3 8B Instruct Thinking Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Human Like LLama3 8B Instruct MPOA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
open llama 3b v2 instruct
Llama · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
LL
CodeLlama 34b Python Hf
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Turkish Llama 8b v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-4-Maverick-17B-128E-Instruct
Llama · DevQuasar-12
Params401B
Context1024K
Q4_K_M242.8 GB
Tool use
LL
Llama 3.1 8B Instruct Uncensored Complete
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama-7b-finnish
Llama · RichardErkhov
Params7B
Context2K
Q4_K_M4.3 GB
GGUF
LL
nvidia.Llama 3 1 Nemotron Ultra 253B CPT v1
Llama · DevQuasar
Params253B
Context128K
Q4_K_M150.9 GB
Tool use
LL
Llama 3.3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7b hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
llama3
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
LL
llama-3-Stheno-Mahou-8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-8B-Ultrachat-200K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Ektome Llama 3.2 3Bi PristinelyUncensored
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
pair preference model LLaMA3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
uzbek llama 3.1 8B instruct v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · mradermacher
Params51.5B
Context128K
Q4_K_M31.0 GB
Tool use
LL
llama-3-chinese
Llama · hfl
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama3.3 8B Instruct Thinking Heretic Uncensored Claude 4.5 Opus High Reasoning
Llama · Mal1cc
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama SEA LION v2 8B IT
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 DiscoLM German 8b v0.1 experimental i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 CURSEDMAGICALGIRL 2 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
GGUF
LL
AI Sweden Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMAntino 2 Chat 13b Hf UltraChat ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing