Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Open Ko 8B Instruct teddynote
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8b pokerbench sft
Llama · YiPz
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B Instruct lorablated
Llama · mlabonne
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 Experiment v1 9B Uncensored
Llama · mradermacher
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
LL
liyimengwork llama 3.1 8B wenyanwen2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 2 7b Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3 DocChat 1.0 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct BE
Llama · taronaeo
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
llama 3 70B uncensored i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
GraphMind LLAMA 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Amelia ACC 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llavon ime llama 250m
Llama · tony65535
Params248M
Context384
Q4_K_M0.2 GB
GGUF
LL
Ichigo llama3.1 s instruct v0.4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Uncensored DeLMAT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Calix CLM 1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMAX2 7B X CSQA
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 ArrowSE v0.4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Minitron 4B Width Base
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
penny lexi llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B claude 3.7 sonnet reasoning distilled
Llama · mfielding92
Params3.21B
Context128K
Smallest1.9 GB
ReasoningTool use
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 DeluxeTrifecta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-128K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 8B Lexi Uncensored GGUF mirror
Llama · EsteefAi
Params8.03B
Context8K
Smallest5.7 GB
GGUF

Keep browsing