Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llama3.2 1b CoT
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
shisa v2.1 llama3.2 3b UD japanese imatrix
Llama · dahara1
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
DLER Llama Nemotron 8B Merge Research
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b instruct LLMPC Red Team i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
LL
EnnoAi-Pro-Llama-3-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-DPO-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Yggdrasil AstralSpice 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
hermes llama3 roleplay 3500 v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
openbuddy llama3.1 8b v22.2 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
70B_llama313_rp
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B OpenO1 SFT v0.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B CodeReactor i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Pathos Theta LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
MFANN Llama3.1 Abliterated SLERP V5 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
NousResearch Hermes 2 Pro Llama 3 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3-70B-Fireplace
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
OpenCarrot llama3 Mix 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B UltraMedical
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
bella bartender 8b llama3.1
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
dakshvar22 cmd gen travel assistant codellama 7b unsloth params
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange reverseengineering
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB