Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
CodeLlama 7B Kexer
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
EVA LLaMA 3.33 70B v0.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Llama 3 Yggdrasil 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Groq 8B Tool Use
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B bonito v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-4-Scout-17B-16E-Instruct
Llama · ggml-org
Params108B
Context10240K
Q4_K_M65.4 GB
Tool useVision
LL
FireStorm Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Lexi-Smaug-Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ektome_Nemotron Nano 8B
Llama · Zynerji
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Artificium llama3.1 8B 001
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama3.1 70B ShiningValiant2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-8b-Cosmopedia-japanese
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Liberalis Cogitator Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 8B Lexi Uncensored i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 8B PlumMath
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 4 Scout Medical MoE Fp8 Base
Llama · mradermacher
Params108B
Context10240K
Q4_K_M65.4 GB
Tool use
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-Groq-8B-Tool-Use
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
llama-3-gutenberg-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing