GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NS
athirdpath/NSFW_DPO_Noromaid-7b
Nsfw · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
Ice0.101 20.03 RP GRPO 2
Icelemonmedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
FI
FinalFintetuning-XVIII-v1.1-2x8B
Finalfintetuning · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
IA
Iambe RP v3 20b i1
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
Roleplay
TE
Weyaxi/test-help-steer-filtered-orig
Test · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
L3 TheSpice 8b v0.1.3
Thespice · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
nox solar 10.7b v4 kolon ITD 5 v2.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
BL
Blind Test
Blind · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GH
ghana voice frafra
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
MO
TheDrummer/Moistral-11B-v3
Moistral · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
KU
grimjim/kunoichi-lemon-royale-v3-32K-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3SOME 8B V2D
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
MI
care arabic mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DAVinCI Yi Ko 6B v1.1
Davinci · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
LL
Llama 3 TenyxChat DaybreakStorywriter 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
Nemo 12b CreativePretrain HalfDone
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Undi95_Llama-3-LewdPlay-8B-evo
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
NO
Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 8B Instruct ortho baukit
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LY
MN 12B Lyra v4a1
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Privoid Bangla SSC Mobile
Gemma · Privoid-ai
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
MI
Franziska Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NA
NarumashiRTS V2
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
MI
K2S3 Mistral 7b v1.4
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama-3-TenyxChat-DaybreakStorywriter-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
CH
ChatWaifu_v1.3.1
Chatwaifu · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
AL
algograpV4
Algograpv · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AL
AlphaMonarch 7B
Alphamonarch · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
JA
jackrabbit 110m ro handy
Jackrabbit · jonah1024
Params115M
Context—
Smallest0.1 GB
GGUF
JS
jsfs11 TurdusTrixBeagle DARETIES 7B
Jsfs · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing