arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.02589cs.AI
收藏

面向集装箱配载规划问题的深度强化学习算法基准研究

A Benchmark Study of Deep Reinforcement Learning Algorithms for the Container Stowage Planning Problem

Leiden University(莱顿大学);Leiden Institute of Advanced Computer Science(莱顿高级计算机科学研究所)

Yunqi Huang, Nishith Chennakeshava, Alexis Carras, Vladislav Neverov, Wei Liu, Aske Plaat, Yingjie Fan

AI总结:

针对集装箱配载规划领域缺乏强化学习算法系统基准对比的问题,构建含多/单智能体岸桥调度的可复用Gym环境,评估五种RL算法在不同复杂度场景下的性能,为海运物流相关研究与应用提供基础。

摘要:

集装箱配载规划(CSPP)是海运与码头运营的核心环节,直接影响供应链效率。由于其复杂性,CSPP传统上依赖人工经验。尽管近期已有强化学习(RL)被应用于CSPP,但不同算法间的系统性基准对比仍较为匮乏。为填补这一空白,我们构建了一个能体现CSPP核心特征的Gym环境,并对其进行扩展,纳入多智能体与单智能体两种形式下的岸桥调度模块。在该框架内,我们在复杂度各异的多个场景下评估了五种RL算法:DQN、QR-DQN、A2C、PPO和TRPO。结果显示,随着复杂度提升,不同算法的性能差距显著,凸显了算法选择与问题建模方式对CSPP的重要性。总体而言,本文对多种应用于CSPP的RL方法进行了基准测试,同时提供了一个含岸桥调度功能的可复用Gym环境,为海运物流领域的未来研究与实际部署奠定了基础。

英文摘要:

Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While reinforcement learning (RL) has recently been applied to CSPP, systematic benchmark comparisons across different algorithms remain limited. To address this gap, we develop a Gym environment that captures the fundamental features of CSPP and extend it to include crane scheduling in both multi-agent and single-agent formulations. Within this framework, we evaluate five RL algorithms: DQN, QR-DQN, A2C, PPO, and TRPO under multiple scenarios of varying complexity. The results reveal distinct performance gaps with increasing complexity, underscoring the importance of algorithm choice and problem formulation for CSPP. Overall, this paper benchmarks multiple RL methods for CSPP while providing a reusable Gym environment with crane scheduling, thus offering a foundation for future research and practical deployment in maritime logistics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑