Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
chinese llama 2 7b 64k
Llama · hfl
Params6.93B
Context64K
Smallest2.6 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
YBXL Med LLaMA3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SlimOrca Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Deep Reasoning Llama 3.2 Instruct uncensored 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Asclepius-Llama2-13B
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3B Q4 K M
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
WiNGPT2 Llama 3 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
openbuddy llama3.1 8b v22.3 131k i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70b Reward Model Biases Merged
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Cogito v2 Preview Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
CodeLlama-7B-KStack
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3 13B
Llama · mradermacher
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
meta llama Llama 2 7b hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 Tulu 2 Dpo 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nsql llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 8B DPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
llama 3 70B Instruct abliterated
Llama · failspy
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLama 3.1 8B Janus Abliterated V2
Llama · SOMEHOTMEAL
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1-70B-Chinese-Chat
Llama · shenzhi-wang
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
gemma 3 4b teste unloth llama.cpp
Llama · alexiaassis
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing