Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Unichat llama3 Chinese 8B 28K
Llama · Monor
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · foxtail2
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
frankencria llama2 12.5b v1.3 m.2 i1
Llama · mradermacher
Params12.4B
Context4K
Q4_K_M7.5 GB
Coding
LL
Meta Llama Llama 3.2 3B Instruct
Llama · aashish1904
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
llama 3.2 3b programming lab
Llama · Neha-Kore45
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
pub llama 13B v6 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B Aleph 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
AMD Llama 135m code
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
Coding
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
saqada Llama 3.1 8B with 16bit merged lora adapters MOV v7
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AkaLlama llama3 70b v0.1
Llama · snupilab
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 13B Instruct Abliterated
Llama · mradermacher
Params13.3B
Context128K
Q4_K_M8.1 GB
GGUF
LL
LLaMA3 iterative DPO final
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RolePlayer V5 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3 8B Lexi Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RLHFlow LLaMA3 iterative DPO final
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 KafkaLM 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMAntino 2 Chat 7b Hf UltraChat ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1b
Llama · ElementMerc
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Linkbricks Horizon AI Korean Advanced 8B
Llama · Saxo
Params8.03B
Context128K
Smallest4.9 GB
Tool use
LL
GRAM RR LLaMA 3.2 3B RewardModel
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
GRAM LLaMA3.2 3B RewardModel
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
OneLLM Doey V1 Llama 3.2 1B it
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama-3-8B-Synthia-v3.5
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3 8B dutch
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing