Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-3-8B-Instruct-UltraDPO3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8b instruct LLMPC Red Team
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · redponike
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ziya Llama 13b Medical Merged
Llama · mradermacher
Params13.1B
Context2K
Q4_K_M7.9 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Malediction V3 LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Barcenas Llama3 8b ORPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3.1-Nemotron-Nano-8B-v1
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
LL
Llama 3.1 Hawkish 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 TaiPhone 3B Instruct v0.2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.3 8B Instruct OmniWriter
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Irene-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta-Llama-3-7B-28Layers
Llama · mradermacher
Params7.16B
Context8K
Q4_K_M4.4 GB
LL
Llama 3 Swallow Infused R1776 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
EVA LLaMA 3.33 70B v0.0 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
MO MODEL Fused Unhinged RP Alpha V2 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
dolphin 2.9 llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaMAX2 7B XNLI
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Kei Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8b Cpt Sea Lionv2 Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ShiningValiantXS
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
LL
CodeLlama 7B KStack
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Roleplay Unhinged Base V1 Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
LL
Llama 3 3 Nemotron Super 49B v1 5 lecore
Llama · staccs
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
Llama 3.1 EstLLM 8B Instruct 1125
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LlamaThink 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB