GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
MagpieLM 8B SFT v0.1 i1
Magpielm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 SuperHawk 8B Heretic v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Chat 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DO
DongfuJiang prm version3 full hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 11b pretrained i1
Llama · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
GGUF
LL
LongWriter Llama3.1 8B Absolute Heresy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Geobot
Geobot · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 8B XGuard Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Cobalt
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Jbliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
L3.1 Moe 2x8B v0.2
Moe · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
GGUF
QU
Question_Builder_Abliterated
Question · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Typhoon v1.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
TxAgent T1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ArrowCanaria Llama 8B RL v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AD
Adversary 8B v1.21
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 8B GRA Condor
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TA
TableLLM 8b
Tablellm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningTool use
LL
Llama 3.1 70B Instruct lorablated
Llama · mlabonne
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Amelia ACC 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uncensored DeLMAT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
Assistant Pepe 70B
Assistant · SicariusSicariiStuff
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama Calix CLM 1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 DeluxeTrifecta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
KR
KRONOS 8B V2 i1
Kronos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing