Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
OntoTune Sftdpo Llama3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 8b instruct hasanpiker abliterated i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ContinuedTraining
Llama · ericflo
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama2 MedTuned 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama3 70B ShiningValiant2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Reasoning Llama 3.2 1B Instruct v1.3 i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
CodeActAgent Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
.\TroyDoesAI Llama 21B
Llama · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
LL
Llama 3.2 3B Instruct
Llama · pingappslab
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Impish_LLAMA_4B_Abliterated
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama 2 7b chat hf
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 11B Vision Instruct
Llama · Sci-fi-vy
Params9.78B
Context128K
Q4_K_M6.0 GB
LL
Llama Fin 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Cogito-V2-Preview-Llama-405B
Llama · unsloth
Params406B
Context128K
Q4_K_M243.1 GB
LL
Llama 3.2 3B Instruct Roleplay Tuned
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
New Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Hercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Chan Shitpost 2.5 Llama Small
Llama · mradermacher
Params9M
Context2K
Q4_K_M0.0 GB
LL
Deepcogito.Cogito v1 Preview Llama 70B
Llama · csabakecskemeti
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Lexi Smaug Uncensored
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 MagicalGirl 2 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 3b Uncensored
Llama · Shyamnath
Params3.61B
Context128K
Smallest3.8 GB
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 7b
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB