Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-32k-v0.1
Llama · MaziyarPanahi
Params70.6B
Context31K
Q4_K_M42.5 GB
LL
ParaLex-Llama-3-8B-SFT
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grok oss Revenant 8B
Llama · c4tdr0ut
Params8.03B
Context128K
Smallest5.7 GB
LL
dolphin-2.9.3-llama-3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama 34b Python hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Huihui ai.Llama 3.1 Nemotron Nano 8B v1 Abliterated
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Heretic Llama Express.1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
PatronusAI Llama 3 Patronus Lynx 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 13B fp16 french
Llama · Nekochu
Params13B
Context4K
Q4_K_M7.9 GB
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
LL
Llama Doctor 3.2 3B Instruct i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Clinical BR LlaMA 2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3-Teal-Instruct-2x8B-MoE
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
LL
dolphin 2.9 llama3 8b
Llama · 3thn
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 kartoffeldes 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Lexi Llama 3 8B Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Portuguese v0.4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama Ione 8B Roleplay v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9 llama3 8b flashback
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated Sabresooth
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
T3Q LLM3 Llama3 sft1.0 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
shisa v2.1 llama3.3 70b i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama 2 tiny random
Llama · aladar
Params—
Context4K
Smallest0.0 GB
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
DeepThought MOE 8X3B R1 Llama 3.2 Reasoning 18B i1
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
LL
Llama 3.1 ARC Potpourri Induction 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Vikhr Llama3.1 8B Instruct R 21 09 24
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB