GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
SA
SAO LightMix 8B Model Stock
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo gpt4 llm
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo evol instruct
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct TTS Phonetic Denglish
Llama · RudraChakrin
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
MIST 1 140B
Mist · mradermacher
Params137B
Context128K
Q4_K_M82.4 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 SuperNovaLite HuatuoSkywork O1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
barc0 barc llama3.1 8b instruct fft transduction gpt4omini10k lr1e 5 epoch1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
Binary Think RM 8B
Binary · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ET
L3.1 EtherealRainbow v1.0 Rc1 8B
Etherealrainbow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange robotics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Bonsaikraft 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Literotica 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ArrowCanaria Llama 8B RL v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Saoirse 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · Twobombs
Params8.03B
Context128K
Smallest4.0 GB
LL
VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev original tiger dataset small
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DI
Distilled DarkPlanet Allades 8B TIES i1
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Jamet 8B MK.I
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B MultiReflection Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama PLLuM 8B Base 2508
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KoBioMed Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 70B PlumChat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB