arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.17178cs.LGcs.NE
收藏

基于图模仿学习的置换流水车间调度优化学习方法

Learning to Optimize Permutation Flow Shop Scheduling via Graph-based Imitation Learning

The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen)(香港中文大学(深圳));Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);National University of Singapore(新加坡国立大学)

Longkang Li, Siyuan Liang, Zihao Zhu, Chris Ding, Hongyuan Zha, Baoyuan Wu

AI总结:

针对大规模置换流水车间调度传统方法精度效率难兼顾、强化学习收敛慢精度低的问题,提出带图编码器的专家驱动模仿学习模型,参数量仅为SOTA强化学习方法的37%,求解差距大幅降低,在千级工件规模问题上泛化性优异。

摘要:

置换流水车间调度(PFSS)旨在寻找工件的最优排列顺序,在制造系统中应用广泛。在求解大规模PFSS问题时,启发式算法等传统优化方法难以同时兼顾求解精度与计算效率,因此基于学习的方法近年来受到更多关注。已有部分研究尝试用强化学习方法求解该问题,但这类方法存在训练收敛速度慢、求解精度仍不足的问题。针对上述问题,本文提出通过专家驱动的模仿学习训练模型,可更稳定、更精准地加快收敛速度。此外,为更好地提取输入工件的特征表示,本文引入图结构作为编码器。大量实验表明,本文提出的模型性能得到显著提升,在包含多达1000个工件的大规模问题中表现出优异的泛化能力。与当前最优的强化学习方法相比,本文模型的网络参数量仅为其37%,且模型解与专家解的求解差距从平均6.8%降至1.3%。代码可在以下链接获取:https://github.com/longkangli/PFSS-IL。

英文摘要:

The permutation flow shop scheduling (PFSS), aiming at finding the optimal permutation of jobs, is widely used in manufacturing systems. When solving large-scale PFSS problems, traditional optimization algorithms such as heuristics could hardly meet the demands of both solution accuracy and computational efficiency, thus learning-based methods have recently garnered more attention. Some work attempts to solve the problems by reinforcement learning methods, which suffer from slow convergence issues during training and are still not accurate enough regarding the solutions. To that end, we propose to train the model via expert-driven imitation learning, which accelerates convergence more stably and accurately. Moreover, in order to extract better feature representations of input jobs, we incorporate the graph structure as the encoder. The extensive experiments reveal that our proposed model obtains significant promotion and presents excellent generalizability in large-scale problems with up to 1000 jobs. Compared to the state-of-the-art reinforcement learning method, our model's network parameters are reduced to only 37\% of theirs, and the solution gap of our model towards the expert solutions decreases from 6.8\% to 1.3\% on average. The code is available at: \url{https://github.com/longkangli/PFSS-IL}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑