Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.2 1B Instruct Abliterated
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
GGUF
LL
Vikhr Llama3.1 8B Instruct R 21 09 24
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B toxic dpo NoWarning i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
kykim0 Llama 2 7b ultrachat code
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
Llama 3.1 8B Stheno v3.4
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Abliterated Llama 3.2 1B Instruct
Llama · ElectricLMA
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 2 7b Ultrachat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
LL
Llama 3.2 4X3B MOE Ultra Instruct 10B
Llama · DavidAU
Params9.95B
Context128K
Q4_K_M6.1 GB
ReasoningRoleplay
LL
Llama3 8b Cpt Sealionv2 Base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
picAIso TARS 8B llama REMIX v2
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · itlwas
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Code-Llama-3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF

Keep browsing