arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.03646cs.LGcs.AI
收藏

ReLA:基于强化学习的作业调度表示学习与聚合

ReLA: Representation Learning and Aggregation for Job Scheduling with Reinforcement Learning

Singapore Institute of Technology(新加坡理工学院);NVIDIA AI Technology Center(NVIDIA人工智能技术中心)

Zhengyi Kwan, Wei Zhang, Aik Beng Ng, Zhengkui Wang, Simon See

AI总结:

ReLA通过强化学习结合结构化表示学习与聚合,实现了在作业调度中更优的调度质量和效率。

摘要:

作业调度在现实世界制造系统中被广泛用于在各种约束下将有序作业操作分配给机器。现有解决方案仍然受到运行时间长或调度质量不足的限制,尤其是在问题规模增加时。在本文中,我们提出了ReLA,一种基于结构化表示学习和聚合的强化学习(RL)调度器。ReLA首先通过两个内在实体学习模块(带有自注意力和卷积)和一个跨实体学习模块(带有交叉注意力)从调度实体中学习多样化的表示,包括作业操作和机器。这些模块应用于多尺度架构,其输出被聚合以支持RL决策。在小、中、大型作业实例上的实验表明,ReLA在大多数测试设置中实现了最佳的完成时间,优于最新解决方案。在非大型实例上,ReLA将SOTA基线的最优性差距减少了13.0%,而在大规模实例上将差距减少了78.6%,平均最优性差距分别降低到7.3%和2.1%。这些结果证实了ReLA所学习的表示和聚合为RL调度提供了强大的决策支持,并使实际应用中的作业完成和决策变得快速。

英文摘要:

Job scheduling is widely used in real-world manufacturing systems to assign ordered job operations to machines under various constraints. Existing solutions remain limited by long running time or insufficient schedule quality, especially when problem scale increases. In this paper, we propose ReLA, a reinforcement-learning (RL) scheduler built on structured representation learning and aggregation. ReLA first learns diverse representations from scheduling entities, including job operations and machines, using two intra-entity learning modules with self-attention and convolution and one inter-entity learning module with cross-attention. These modules are applied in a multi-scale architecture, and their outputs are aggregated to support RL decision-making. Across experiments on small, medium, and large job instances, ReLA achieves the best makespan in most tested settings over the latest solutions. On non-large instances, ReLA reduces the optimality gap of the SOTA baseline by 13.0%, while on large-scale instances it reduces the gap by 78.6%, with the average optimality gaps lowered to 7.3% and 2.1%, respectively. These results confirm that ReLA's learned representations and aggregation provide strong decision support for RL scheduling, and enable fast job completion and decision-making for real-world applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑