arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.04423cs.LGcs.AI
收藏

车间作业调度中调度规则的泛化学习

Learning to generalize Dispatching rules on the Job Shop Scheduling

Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)

Zangir Iklassov, Dmitrii Medvedev, Ruben Solozabal, Martin Takac

摘要:

本文介绍了一种强化学习方法,以更好地推广启发式调度规则的作业车间调度问题(JSP)。当前的JSP模型并不关注泛化,尽管正如我们在这项工作中所展示的那样,这是学习更好地解决问题的关键。一种众所周知的提高泛化能力的技术是使用课程学习(CL)在越来越复杂的实例上学习。然而,正如许多文献中所指出的那样,当在不同的问题大小之间转移所学到的技能时,这种技术可能会遭受灾难性遗忘。为了解决这个问题,我们引入了一种新的对抗性课程学习(ACL)策略,该策略在学习过程中动态调整难度水平,以重新访问表现最差的实例。本文还提出了一个深度学习模型来解决JSP问题,该模型与传统的JSP模型是等变的。作业定义和大小不可知。在Taillard和Demirkol的实例上进行的实验表明,所提出的方法显着改善了JSP上当前最先进的模型。在Taillard和Demirkol两个实例上,最优性差距分别从19.35%和38.43%减小到10.46%和18.85%.我们的实现可在线获得。

英文摘要:

This paper introduces a Reinforcement Learning approach to better generalize heuristic dispatching rules on the Job-shop Scheduling Problem (JSP). Current models on the JSP do not focus on generalization, although, as we show in this work, this is key to learning better heuristics on the problem. A well-known technique to improve generalization is to learn on increasingly complex instances using Curriculum Learning (CL). However, as many works in the literature indicate, this technique might suffer from catastrophic forgetting when transferring the learned skills between different problem sizes. To address this issue, we introduce a novel Adversarial Curriculum Learning (ACL) strategy, which dynamically adjusts the difficulty level during the learning process to revisit the worst-performing instances. This work also presents a deep learning model to solve the JSP, which is equivariant w.r.t. the job definition and size-agnostic. Conducted experiments on Taillard's and Demirkol's instances show that the presented approach significantly improves the current state-of-the-art models on the JSP. It reduces the average optimality gap from 19.35\% to 10.46\% on Taillard's instances and from 38.43\% to 18.85\% on Demirkol's instances. Our implementation is available online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑