Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
MFANN Llama3.1 Abliterated SLERP V4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 Taiwan 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Coding Expert
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B
Llama · mradermacher
Params1.72B
Context128K
Q4_K_M1.1 GB
GGUF
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Uncensored Dare
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ichigo llama3.1 s instruct v0.4
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 8b Dolphin Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
PULI LlumiX Llama 3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
llama-3-typhoon-v1.5-8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 PeanutButter v19 R8 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta-Llama-3-70B-Instruct
Llama · qwp4w3hyb
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama Breeze2 8B Instruct Text Only
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · medmekk
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Latxa Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B OmniMatrix
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball Llama 3.11 8B v1orpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMAntino 3 ANITA 8B Inst DPO ITA
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B ClauseLM
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing