GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
LLaMa 3.1 Korean Reasoning 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 evol instruct x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm math only hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo 0.4 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive R1 V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Mercury In Retrograde 8b Model Stock i1
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Gemma 2 27b CPO SimPO iter2
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
mlfoundations dev llama3 1 8b webinstruct original 700k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm gsm all data bon 4 hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 SuperHawk 8B Heretic v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DobHerHard R1 v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1
Llama · cortexso
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo null sources
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QI
QiMing Holos Plus 8B
Qiming · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Daewon0808 prm800k llama fulltune
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo 2.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
VISION 1
Vision · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Chat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Danoia
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo 2.0 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Osuda v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Deepcogito.Cogito v1 Preview Llama 8B
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EIRAI 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MIST Mini 8B
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB