arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.03136cs.LG
收藏

设计过程是一个强化学习问题

Design Process is a Reinforcement Learning Problem

ETH Zurich(苏黎世联邦理工学院)

Reza kakooee, Benjamin Dillunberger

摘要:

虽然在过去的几年里,强化学习已在研究中得到广泛应用,但由于强化学习算法存在一些弱点,例如从模拟器过渡到现实世界时的性能下降,它发现的现实世界应用比监督学习少。世界。在这里,我们认为设计过程是一个强化学习问题,并且可能是RL算法的适当应用,因为它是一个离线过程,并且通常是在CAD软件中完成的-一种模拟器。这为使用RL方法创造了机会,同时也带来了挑战。虽然设计过程是如此多样化,在这里,我们专注于空间布局规划(SLP),框架下的马尔可夫决策过程的RL问题,并使用PPO来解决布局设计问题。为此,我们开发了一个名为RLDesigner的环境来模拟SLP。RLDesigner是一个OpenAI Gym兼容环境,可以轻松自定义以定义各种设计场景。我们公开分享环境,以鼓励RL和架构社区使用它来测试不同的RL算法或在他们的设计实践中。代码可以在以下GitHub存储库中找到:https://github.com/ RezaKakooee/rldesigner/tree/Second_Paper

英文摘要:

While reinforcement learning has been used widely in research during the past few years, it found fewer real-world applications than supervised learning due to some weaknesses that the RL algorithms suffer from, such as performance degradation in transitioning from the simulator to the real world. Here, we argue the design process is a reinforcement learning problem and can potentially be a proper application for RL algorithms as it is an offline process and conventionally is done in CAD software - a sort of simulator. This creates opportunities for using RL methods and, at the same time, raises challenges. While the design processes are so diverse, here we focus on the space layout planning (SLP), frame it as an RL problem under the Markov Decision Process, and use PPO to address the layout design problem. To do so, we developed an environment named RLDesigner, to simulate the SLP. The RLDesigner is an OpenAI Gym compatible environment that can be easily customized to define a diverse range of design scenarios. We publicly share the environment to encourage both RL and architecture communities to use it for testing different RL algorithms or in their design practice. The codes are available in the following GitHub repository https://github.com/ RezaKakooee/rldesigner/tree/Second_Paper

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑