Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-3-8B-Magpie-Align-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 8B abliterated 1793043119
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Pruned 4 Layers
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
Code-Llama-Bagel-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-Korean-Bllossom-8B
Llama · MLP-KTLim
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Configurable-Llama-3-8B-v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Uncensored 1b Creative Writing RP
Llama · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
LL
Meta Llama 3.1 8B
Llama · fedric95
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
babydolphin 8b llama3 uncensored
Llama · babycommando
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Solidity-Llama3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Stheno-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
LL
MathCoder2 Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · cinnabrad
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ReWiz Llama 3.1 8B v2
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Gpt Oss 120b Distill Llama3.1 8B v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Reasoner 1o1 v0.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · Orenguteng
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Genius_OpenHermes 32K_LLaMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ihughes15234 llama 3 1 8bi tictactoe dpo3epoch v2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 EstLLM 8B Instruct 0825
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align v0.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Joah-Llama-3-MAAL-MLP-KoEn-8B-Reborn
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Spectrum Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
ArliAI Llama 3 8B Instruct Dolfin v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB