arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.12420cs.RO
收藏

通过深度强化学习的装箱优化

Bin Packing Optimization via Deep Reinforcement Learning

Zhejiang University(浙江大学)

Baoying Wang, Huixu Dong

AI总结:

针对装箱问题,提出基于深度强化学习的端到端方法,优化装箱顺序与放置策略,提升空间利用率并减少箱子使用,实验证明在精度和效率上优于传统方法。

摘要:

装箱问题(BPP)近年来因其在物流和仓储环境中的广泛应用而引起了热烈的研究兴趣。优化装箱以使得更多物体能够被装入箱子中是非常必要的。物体装箱顺序和放置策略是BPP的两个关键优化目标。然而,现有的BPP优化方法,如遗传算法(GA),主要存在计算成本高和精度相对较低的问题,使其难以在实际场景中实施。为了很好地弥补这些研究空白,我们提出了一种新颖的优化方法,通过深度强化学习(DRL)对规则形状物体的二维(2D)-BPP和三维(3D)-BPP进行优化,最大化空间利用率并最小化箱子的使用数量。首先,提出了一种由改进的指针网络构建的端到端DRL神经网络,该网络由编码器、解码器和注意力模块组成,以实现最优的物体装箱顺序。其次,遵循自上而下的操作模式,基于高度图的放置策略用于在箱子中排列有序的物体,防止物体与箱子以及箱子内其他物体发生碰撞。第三,将奖励和损失函数定义为紧凑性、金字塔和箱子使用数量的指标,以基于策略的演员-评论家框架进行DRL神经网络的训练。最后,进行了一系列实验,将我们的方法与传统的装箱方法进行比较,从中我们得出结论,我们的方法在装箱精度和效率方面均优于这些装箱方法。

英文摘要:

The Bin Packing Problem (BPP) has attracted enthusiastic research interest recently, owing to widespread applications in logistics and warehousing environments. It is truly essential to optimize the bin packing to enable more objects to be packed into boxes. Object packing order and placement strategy are the two crucial optimization objectives of the BPP. However, existing optimization methods for BPP, such as the genetic algorithm (GA), emerge as the main issues in highly computational cost and relatively low accuracy, making it difficult to implement in realistic scenarios. To well relieve the research gaps, we present a novel optimization methodology of two-dimensional (2D)-BPP and three-dimensional (3D)-BPP for objects with regular shapes via deep reinforcement learning (DRL), maximizing the space utilization and minimizing the usage number of boxes. First, an end-to-end DRL neural network constructed by a modified Pointer Network consisting of an encoder, a decoder and an attention module is proposed to achieve the optimal object packing order. Second, conforming to the top-down operation mode, the placement strategy based on a height map is used to arrange the ordered objects in the boxes, preventing the objects from colliding with boxes and other objects in boxes. Third, the reward and loss functions are defined as the indicators of the compactness, pyramid, and usage number of boxes to conduct the training of the DRL neural network based on an on-policy actor-critic framework. Finally, a series of experiments are implemented to compare our method with conventional packing methods, from which we conclude that our method outperforms these packing methods in both packing accuracy and efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑