arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.07684cs.AIcs.LGmath.OC
收藏

基于共享资源的库存管理多智能体强化学习

Multi-Agent Reinforcement Learning with Shared Resources for Inventory Management

Huazhong University of Science and Technology(华中科技大学);University of Science and Technology of China(中国科学技术大学);Carnegie Mellon University(卡内基梅隆大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft Research(微软研究院)

Yuandong Ding, Mingxiao Feng, Guozi Liu, Wei Jiang, Chuheng Zhang, Li Zhao, Lei Song, Houqiang Li, Yan Jin, Jiang Bian

摘要:

在本文中,我们考虑的库存管理(IM)的问题,我们需要作出补充决策,大量的库存单位(SKU),以平衡其供应和需求。在我们的设置中,对共享资源(如库存容量)的约束耦合了对每个子系统的独立控制。我们制定了这个结构的共享资源随机博弈(SRSG)的问题,并提出了一个有效的算法称为上下文感知分散PPO(CD-PPO)。通过大量的实验,我们证明了CD-PPO可以加速学习过程相比,标准的MARL算法。

英文摘要:

In this paper, we consider the inventory management (IM) problem where we need to make replenishment decisions for a large number of stock keeping units (SKUs) to balance their supply and demand. In our setting, the constraint on the shared resources (such as the inventory capacity) couples the otherwise independent control for each SKU. We formulate the problem with this structure as Shared-Resource Stochastic Game (SRSG)and propose an efficient algorithm called Context-aware Decentralized PPO (CD-PPO). Through extensive experiments, we demonstrate that CD-PPO can accelerate the learning procedure compared with standard MARL algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑