Llama GGUF models

30022 GGUF models in the Llama family, quantized by 7347 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 8B Instruct 128K_Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
arnavgrg codellama 13b instruct nf4 fp16 upscaled
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Python Tab Completion CodeLlama 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
hermes llama3 roleplay 4000 v5 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Layerskip Llama3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama3.1 SuperHawk 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hemispheres v0.2 Llama3.2 3B Final
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Vikhr-Llama-3.2-1B-Instruct-abliterated
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
AIML GEEK promptv5 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
LLama Rhino 8B RAG i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron Safety Guard 8B v3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev llama3 1 8b oh v3.1 wo gpteacher
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Clin REACT 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Finnish NLP llama 7b finnish instruct v0.2
Llama · RichardErkhov
Params7B
Context2K
Q4_K_M4.3 GB
GGUF
LL
Magpie Align Llama 3 8B Magpie Align v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B openassistant guanaco llama2 format i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Prox-Llama-3-8B-abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama Poro 2 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B ProdigyPlus i1
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Llama_3.3_70b_L3.3 NegativeLlama_abliterated_fusion
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Amelia ED 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
posicube Llama2 chat AYB 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Leo Hessianai 7b P1 Llama Errors P2 GEC
Llama · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-8B-Ultra-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SEX ROLEPLAY 3.2 1B Q4 K M
Llama · Novaciano
Params1.5B
Context128K
Q4_K_M1.0 GB
ReasoningRoleplayTool use
LL
Alucard Hellsing Llama3.2 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF

Keep browsing