GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMa 3.1 Korean Reasoning 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ML
mlfoundations dev oh v1.3 evol instruct x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
DongfuJiang prm math only hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Apollo 0.4 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Hermedive R1 V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
ME
Mercury In Retrograde 8b Model Stock i1
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Gemma 2 27b CPO SimPO iter2
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
mlfoundations dev llama3 1 8b webinstruct original 700k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
DongfuJiang prm gsm all data bon 4 hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 SuperHawk 8B Heretic v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DobHerHard R1 v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3.1
Llama · cortexso
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo null sources
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QI
QiMing Holos Plus 8B
Qiming · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Daewon0808 prm800k llama fulltune
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Apollo 2.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VI
VISION 1
Vision · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
LL
Llama PLLuM 8B Chat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Danoia
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Apollo 2.0 Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Osuda v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Deepcogito.Cogito v1 Preview Llama 8B
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EIRAI 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
MIST Mini 8B
Mist · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing