arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.03375cs.LGmath.OC
收藏

基于强化学习的过程设计迁移学习

Transfer learning for process design with reinforcement learning

Delft University of Technology(代尔夫特理工大学)

Qinghe Gao, Haoyu Yang, Shachi M. Shanbhag, Artur M. Schweidtmann

摘要:

工艺设计是一项创造性的任务,目前由工程师手动执行。人工智能为促进工艺设计提供了新的潜力。具体而言,强化学习(RL)通过将学习构建过程流程图的数据驱动模型与迭代设计过程中的过程模拟相集成,在自动化过程设计方面取得了一定的成功。然而,学习过程中的一个主要挑战是,RL代理需要在严格的过程模拟器中进行大量的过程模拟,从而需要较长的模拟时间和昂贵的计算能力。因此,通常采用捷径模拟方法来加速学习过程。然而,捷径方法可能导致不准确的结果。因此,我们建议利用迁移学习的过程设计与RL结合严格的模拟方法。迁移学习是一种来自机器学习的成熟方法,它存储在解决一个问题时获得的知识,并在不同的目标域上重用这些信息。我们将迁移学习集成到我们的强化学习过程设计框架中,并将其应用于一个包括平衡反应,共沸分离和精馏的示例性案例研究,我们的方法可以设计经济可行的流程,并与DWSIM稳定的相互作用。我们的研究结果表明,迁移学习使RL能够使用DWSIM经济地设计可行的流程,从而使流程的收入提高8%。学习时间可以减少2倍。

英文摘要:

Process design is a creative task that is currently performed manually by engineers. Artificial intelligence provides new potential to facilitate process design. Specifically, reinforcement learning (RL) has shown some success in automating process design by integrating data-driven models that learn to build process flowsheets with process simulation in an iterative design process. However, one major challenge in the learning process is that the RL agent demands numerous process simulations in rigorous process simulators, thereby requiring long simulation times and expensive computational power. Therefore, typically short-cut simulation methods are employed to accelerate the learning process. Short-cut methods can, however, lead to inaccurate results. We thus propose to utilize transfer learning for process design with RL in combination with rigorous simulation methods. Transfer learning is an established approach from machine learning that stores knowledge gained while solving one problem and reuses this information on a different target domain. We integrate transfer learning in our RL framework for process design and apply it to an illustrative case study comprising equilibrium reactions, azeotropic separation, and recycles, our method can design economically feasible flowsheets with stable interaction with DWSIM. Our results show that transfer learning enables RL to economically design feasible flowsheets with DWSIM, resulting in a flowsheet with an 8% higher revenue. And the learning time can be reduced by a factor of 2.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑