Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
CleverBoi Llama 3.1 8B Instruct
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 gutenberg 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 70B Esper i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
TinyStories LLaMA2 20M 256h 4l GQA
Llama · mradermacher
Params20M
Context2K
Q4_K_M0.0 GB
GGUF
LL
Llama 3.3 Nemotron 70B Reward Principle
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Vikhr-Llama-3.2-1B-instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama32 1b llm abliteration
Llama · muhammadrafifatihulihsan
Params1.5B
Context128K
Smallest3.0 GB
Tool use
LL
Llama 3.1 8B OmniMatrix i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Tulu 2 70b
Llama · mradermacher
Params70.6B
Context2K
Q4_K_M42.5 GB
GGUF
LL
OpenBioLLM Llama3 8B
Llama · aaditya
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Umbral-Mind-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EstLLM 8B 0525
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Danoia
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Minitron 4B Magpie SFT 650K MT
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Cat-Llama-3-70B-instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3.2 3B Claude Reasoning Distill
Llama · codestrate
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Open Insurance LLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama31 eros i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K GGUF IQ Imatrix Request
Llama · LWDCLS
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CleverBoi Llama 3.2 3B Instruct
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama3.1 8B Cobalt
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B Instruct Abliterated v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Ichigo llama3.1 s instruct v0.3 phase 3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF

Keep browsing