Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 OffsetBias 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Small Llama3 6B
Llama · ukung
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
LongWriter Llama3.1 8b Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Pruned 3 Layers
Llama · mradermacher
Params7.16B
Context128K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Travelplanner SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Code-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 Discord Short 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k i1
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Pro SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Unsafe Llama 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 airoboros3.2 QDT 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Tulu v2.5 8b Uf Mean 70b Uf Rm Mixed Prompts
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
civic-ai-llama
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct 24 9 29
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
openbuddy llama2 70B v13 base
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
LL
Llama 3.1 70B Heretic Lora
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
llama-3-youko-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Cat-Llama-3-70B-instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama 3 zilo sql
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 8B BookAdventures
Llama · KoboldAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B SFT
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama PLLuM 70B Chat 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Lexi Uncensored
Llama · Andycurrent
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Yi 6B 200K Llama
Llama · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
LL
LlamaScientific 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing