Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3 OpenBioMed 8B dare ties 4x
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1_Korean_V1.4_Sft_By_Aidx
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 8X3B GATED MOE Reasoning Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MedPHINER Llama 3.1 Swallow 8B Instruct v0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Bella Bartender 8b Llama3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
thkim0305 Meta Llama3 8B Circuit breaker
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 6B v0
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
LL
Llama 3 Youko 70b Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Mahou 1.5 llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8b Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 10B Instruct i1
Llama · mradermacher
Params9.99B
Context128K
Q4_K_M6.1 GB
LL
FineTome Llama3.2 3B 1002
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Contextual-Obedient-MoE-3x8B-Llama3-RAG
Llama · mradermacher
Params19.3B
Context8K
Q4_K_M11.7 GB
LL
Llama 3.1 8b DeepDive 3 R1 Prev v1.0 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 natural farmer 16bit i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · DevQuasar-10
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 13B Instruct i1
Llama · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
LL
Llama 3.2 3b Psychotherapy Cbt
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama2 13B ShiningValiant i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
phildunphy14 llama 3 1 non quant 8b 55k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
GOAT coder llama3.1 8b
Llama · kshabana
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-neural-chat-v2.2-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 70b Uncensored
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Magpie Align SFT v0.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Instruct 128K_Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB