Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · second-state
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.2 3b NSFW Aesir Uncensored
Llama · Novaciano
Params3.61B
Context128K
Smallest2.0 GB
Roleplay
LL
Trendyol Cybersecurity LLM v2 70B Q4 K M
Llama · Trendyol
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision
LL
Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Open Insurance LLM Llama3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Krikri 8b Instruct
Llama · ilsp
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama 3 8B ProLong 64k Base
Llama · RichardErkhov
Params8B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NousResearch DeepHermes 3 Llama 3 3B Preview
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningRoleplayTool use
LL
Llama 3.1 Storm 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 13B Instruct v0.1
Llama · MaziyarPanahi
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
Llama 3.3 70B Instruct ablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Openthai Llama Pretrained 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
LL
llama-3-8b-samantha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Code-Llama-2-13B-instruct-text2sql
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
CaptureTheFlag CypherMindLLM XRLAB
Llama · ErenAta00
Params8B
Context128K
Smallest6.6 GB
GGUF
LL
llama 2 7b chat catala
Llama · xaviviro
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
WizardLM Mistral CodeLlama 7b
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing