Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Ichigo llama3.1 s base v0.3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Standard Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.1 11b pretrained i1
Llama · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
GGUF
LL
MaziyarPanahi calme 2.2 llama3 70b
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8B Absolute Heresy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta-Llama-3-120B-Instruct
Llama · bartowski
Params122B
Context8K
Q4_K_M73.2 GB
GGUF
LL
DigitalForensicsText2SQLite
Llama · pawlaszc
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama3 stanford encyclopedia philosophy QA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · failspy
Params70.6B
Context8K
Smallest34.3 GB
GGUF
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Negative_LLAMA_70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
SOVL_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 2.0
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
GGUF
LL
codellama_codellama-7b-instruct-hf
Llama · DevShubham
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.2 1B Intruct Tool Calling V2
Llama · nguyenthanhthuan
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
Sheared LLaMA 1.3B
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
GGUF
LL
llama-3-cat-8b-instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-WizardLM-196K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
openbuddy_openbuddy-llama2-13b64k-v15
Llama · TheBloke
Params13.1B
Context64K
Q4_K_M7.9 GB
GGUF
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · LWDCLS
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 10b It Kor Extented Chang
Llama · RichardErkhov
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF
LL
Llama 3.1 8B XGuard Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 2 13b Lemon Alpaca
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF

Keep browsing