Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama Guard 3 1B
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Vision
LL
llava llama 3 8b v1 1 GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
Vision
LL
MultiPL-T-CodeLlama_34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Dorna Llama3 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 13B Instruct
Llama · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
Reasoning
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
GGUF
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nvidia Llama3 ChatQA 1.5 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2 13B Psyfighter2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.9
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMAntino 2 7b Hf ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 EIRAI 8B Prob i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenBioLLM Llama3 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Artificium llama3.1 8B 001
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA3 iterative DPO final
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
calme 2.4 llama3 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Keep browsing