Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llama3.2 1b CoT
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
LL
shisa v2.1 llama3.2 3b UD japanese imatrix
Llama · dahara1
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DLER Llama Nemotron 8B Merge Research
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8b instruct LLMPC Red Team i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
GGUF
LL
EnnoAi-Pro-Llama-3-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-DPO-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Yggdrasil AstralSpice 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
hermes llama3 roleplay 3500 v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
openbuddy llama3.1 8b v22.2 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
70B_llama313_rp
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 8B OpenO1 SFT v0.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 3B CodeReactor i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
Pathos Theta LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
MFANN Llama3.1 Abliterated SLERP V5 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
NousResearch Hermes 2 Pro Llama 3 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3-70B-Fireplace
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
OpenCarrot llama3 Mix 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B UltraMedical
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
bella bartender 8b llama3.1
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
dakshvar22 cmd gen travel assistant codellama 7b unsloth params
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange reverseengineering
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B v0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding

Keep browsing