Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 3B COT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Polypsyche Llama 3.1 8B Instruct Agent 0.0031 128K code ds auto divergent i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin3 nsfw gf chat
Llama · jmachine
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Arabic Orpo Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
reflection llama 3.1 8B Solshine Full
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3 8b instruct 262k chinese
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
Llama Poro 2 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FactAlign LLaMA 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
GGUF dataset avaliev chat doctor unsolth llama3.1 1b3bconverstional
Llama · RahulDrabit
Params460M
Context—
Q4_K_M0.3 GB
LL
Smol_Llama 4x220M MoE
Llama · mradermacher
Params595M
Context2K
Q4_K_M0.4 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.x 70b Tess Cat 128K v1.0 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
SpellBlade
Llama · mradermacher
Params69B
Context4K
Q4_K_M42.3 GB
LL
Llama3 Instruct OpenBioLLM 8B merged i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
hermes llama3 roleplay 2000 v3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AIML GEEK advanced promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama OuteTTS 1.0 1B
Llama · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
LL
Llama 3.2 3b NSFW Aesir Uncensored
Llama · Anubis136
Params3.61B
Context128K
Smallest2.0 GB
LL
Llama3.1 SuperHawk 8B Heretic v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Chat 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MMed Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Diffusion Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
shisa-v2-llama3.3-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 ELYZA JP 8B Heretic
Llama · ChiKoi7
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 ELYZA JP 8B Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB