Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama3 Med42 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama Joycaption Beta One Hf Llava
Llama · H1coM
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8B openorca20k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3 1B Base
Llama · tensorblock
Params1.71B
Context8K
Smallest0.9 GB
GGUF
LL
ConfTuner LLaMA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Nephilim v3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Sentient 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
AVA Llama3.2 1B
Llama · MehdiHosseiniMoghadam
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Eunoia Llama 8B R1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 Base 8B DICE Iter2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Ektome Llama 3.1 8B PristinelyUncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.3 70B Instruct Elite v1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.2 1B Hinglish
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama3 KALE LM Chem 1.5 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Human Like LLama3 8B Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
NurseSim Triage Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
naps llama 3 1 8b instruct v0.4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3 8B 3SOME v2 Regularized
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Smaug-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama_3.x_70b_FLDx2 L3.3_abliterated_fusion
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
naps llama 3 1 instruct v0.5.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SinLlama Llama 3 8B Merged
Llama · mradermacher
Params8.12B
Context8K
Q4_K_M5.0 GB
GGUF
LL
Llama 3 8B Web GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70b Hallucinations Reduced
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Fusion 8020
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing