Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3 Open Ko 8B Instruct teddynote
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8b pokerbench sft
Llama · YiPz
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · mlabonne
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Experiment v1 9B Uncensored
Llama · mradermacher
Params8.9B
Context8K
Q4_K_M5.4 GB
LL
liyimengwork llama 3.1 8B wenyanwen2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 7b Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama3 DocChat 1.0 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct BE
Llama · taronaeo
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama 3 70B uncensored i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
GraphMind LLAMA 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia ACC 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llavon ime llama 250m
Llama · tony65535
Params248M
Context384
Q4_K_M0.2 GB
LL
Ichigo llama3.1 s instruct v0.4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uncensored DeLMAT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Calix CLM 1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMAX2 7B X CSQA
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.3 8B Instruct 128K Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 ArrowSE v0.4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
penny lexi llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B claude 3.7 sonnet reasoning distilled
Llama · mfielding92
Params3.21B
Context128K
Smallest1.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 DeluxeTrifecta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-128K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Lexi Uncensored GGUF mirror
Llama · EsteefAi
Params8.03B
Context8K
Smallest5.7 GB