arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.16035cs.LGcs.AIcs.FLcs.SYeess.SYstat.ML
收藏

将工业4.0环境建模为FSM转换为OpenAI Gym包装器的工具的概念和实现

Concept and the implementation of a tool to convert industry 4.0 environments modeled as FSM to an OpenAI Gym wrapper

UTFPR - Federal University of Technology Paraná(巴拉那联邦技术大学(UTFPR))

Kallil M. C. Zielinski, Marcelo Teixeira, Richardson Ribeiro, Dalcimar Casanova

摘要:

工业4.0系统在其任务中对优化有很高的要求,无论是最大限度地降低成本,最大限度地提高产量,还是同步其执行器以完成或加快产品的制造。这些挑战使得工业环境成为应用所有现代强化学习(RL)概念的合适场景。然而,主要的困难是缺乏这种工业环境。通过这种方式,这项工作提出了一个工具的概念和实现,该工具允许我们将任何建模为FSM的动态系统转换为开源的Gym包装器。在此之后,可以使用任何RL方法来优化任何所需的任务。在该工具的第一个测试中,我们展示了在两个简单环境中运行的传统Q学习和深度Q学习方法。

英文摘要:

Industry 4.0 systems have a high demand for optimization in their tasks, whether to minimize cost, maximize production, or even synchronize their actuators to finish or speed up the manufacture of a product. Those challenges make industrial environments a suitable scenario to apply all modern reinforcement learning (RL) concepts. The main difficulty, however, is the lack of that industrial environments. In this way, this work presents the concept and the implementation of a tool that allows us to convert any dynamic system modeled as an FSM to the open-source Gym wrapper. After that, it is possible to employ any RL methods to optimize any desired task. In the first tests of the proposed tool, we show traditional Q-learning and Deep Q-learning methods running over two simple environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑