Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-8B-Magpie-Align-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 8B abliterated 1793043119
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Pruned 4 Layers
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
GGUF
LL
Code-Llama-Bagel-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
llama-3-Korean-Bllossom-8B
Llama · MLP-KTLim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Configurable-Llama-3-8B-v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Uncensored 1b Creative Writing RP
Llama · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
CodingReasoningRoleplay
LL
Meta Llama 3.1 8B
Llama · fedric95
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
babydolphin 8b llama3 uncensored
Llama · babycommando
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Solidity-Llama3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama-3-Stheno-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
LL
MathCoder2 Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama Joycaption Beta One Hf Llava
Llama · cinnabrad
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
LL
ReWiz Llama 3.1 8B v2
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Gpt Oss 120b Distill Llama3.1 8B v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B Instruct Reasoner 1o1 v0.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored
Llama · Orenguteng
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Genius_OpenHermes 32K_LLaMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ihughes15234 llama 3 1 8bi tictactoe dpo3epoch v2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EstLLM 8B Instruct 0825
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Magpie Align v0.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Joah-Llama-3-MAAL-MLP-KoEn-8B-Reborn
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Spectrum Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
ArliAI Llama 3 8B Instruct Dolfin v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova 8B Lite TIES with Base i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing