Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B
Llama · tinyopsec
Params1.07B
Context128K
Q4_K_M1.0 GB
GGUF
LL
LLaMAX2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama3.2 3b 122824 uncensored i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
LL
Llama 3 8B SFT RuoZhiBa
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 s base v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 3B Instruct imatrix
Llama · liodon-ai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
LexiFun
Llama · Orenguteng
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Latxa Llama 3.1 70B Instruct v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.3 70B Instruct Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 Tulu v2.5 8b Uf Mean 8b Uf Rm
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · BenevolenceMessiah
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
calme-2.3-legalkit-8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
StockLLama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
hermes llama3 roleplay 1000 v7 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Cendol Llama2 13b Merged
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 11B Vision Instruct OLLAMA
Llama · EnlistedGhost
Params10.7B
Context128K
Q4_K_M7.8 GB
Vision
LL
Llama-3-8B-Ultra-Instruct
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Fireball R1 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Na0s Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
GGUF
LL
Unichat llama3 Chinese 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.3 70B Instruct Chinese Elite v1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
LEMA Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 8B 16K GGUF smashed
Llama · PrunaAI
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
LL
winglian llama 3 8b 256k PoSE
Llama · RichardErkhov
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
moondream2
Llama · cjpais
Params1.42B
Context2K
Smallest1.1 GB
Vision
LL
Phoenix Llama 3.1 70B Uncensored
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing