Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama3 Med42 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · H1coM
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 3.1 8B openorca20k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 1B Base
Llama · tensorblock
Params1.71B
Context8K
Smallest0.9 GB
LL
ConfTuner LLaMA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Nephilim v3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
AVA Llama3.2 1B
Llama · MehdiHosseiniMoghadam
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Eunoia Llama 8B R1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Base 8B DICE Iter2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Ektome Llama 3.1 8B PristinelyUncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.3 70B Instruct Elite v1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 1B Hinglish
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama3 KALE LM Chem 1.5 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Human Like LLama3 8B Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
NurseSim Triage Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
naps llama 3 1 8b instruct v0.4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B 3SOME v2 Regularized
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Smaug-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama_3.x_70b_FLDx2 L3.3_abliterated_fusion
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
naps llama 3 1 instruct v0.5.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SinLlama Llama 3 8B Merged
Llama · mradermacher
Params8.12B
Context8K
Q4_K_M5.0 GB
LL
Llama 3 8B Web GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 70b Hallucinations Reduced
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Fusion 8020
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB