Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Uncensored-Frank-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
self after dark
Llama · Gurubot
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama-7B-KStack-clean
Llama · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
ELYZA japanese CodeLlama 7b
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 65b hf
Llama · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
LL
Llama3.1 TheiaFire DarkFusion 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningRoleplay
LL
Llama-3-8B-Ultra-Instruct-SaltSprinkle
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
MopeyMule-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B Instruct Lorablated Creative Writer
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · PrunaAI
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · qwp4w3hyb
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
microsoft LLaMA 2 7b GTL Delta
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
Coding
LL
HexaMind Llama3.1 8B S21 v29
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 KokoroChat Low i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.2-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
Roleplay
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Ambuj Tripathi Indian Legal Llama
Llama · invincibleambuj
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
LLaMA 2 7B 32K
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.2 6B AlgoCode
Llama · mradermacher
Params6.34B
Context128K
Q4_K_M5.6 GB
CodingTool use
LL
llama 3 typhoon v1.5x 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing