arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.04037cs.LGcs.AIcs.MAstat.ML
收藏

供应链多产品多节点库存管理的强化学习

Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chains

TCS Research(塔塔咨询服务公司研究院);Robert Bosch Centre for Data Science and AI, IIT Madras(印度理工学院马德拉斯分校罗伯特·博世数据科学与人工智能中心)

Nazneen N Sultana, Hardik Meisheri, Vinita Baniwal, Somjit Nath, Balaraman Ravindran, Harshad Khadilkar

摘要:

本文描述了强化学习(RL)在供应链多产品库存管理中的应用。问题描述和解决方案都改编自现实世界的业务解决方案。这个问题的新颖之处就供应链文献是(i)我们考虑并发库存管理的大量(50到1000)的产品共享能力,(ii)我们考虑了一个多节点的供应链,由一个仓库,供应三个商店,(iii)仓库,商店和运输从仓库到商店有有限的能力,(iv)仓库和商店补货发生在不同的时间尺度上,并且具有实际的时间滞后,以及(v)商店对产品的需求是随机的。我们描述了一种新的配方在多代理(分层)强化学习框架,可用于并行决策,并使用优势演员评论(A2C)算法与量化的行动空间来解决这个问题。实验表明,该方法是能够处理多目标奖励最大化的产品销售和最小化易腐产品的浪费。

英文摘要:

This paper describes the application of reinforcement learning (RL) to multi-product inventory management in supply chains. The problem description and solution are both adapted from a real-world business solution. The novelty of this problem with respect to supply chain literature is (i) we consider concurrent inventory management of a large number (50 to 1000) of products with shared capacity, (ii) we consider a multi-node supply chain consisting of a warehouse which supplies three stores, (iii) the warehouse, stores, and transportation from warehouse to stores have finite capacities, (iv) warehouse and store replenishment happen at different time scales and with realistic time lags, and (v) demand for products at the stores is stochastic. We describe a novel formulation in a multi-agent (hierarchical) reinforcement learning framework that can be used for parallelised decision-making, and use the advantage actor critic (A2C) algorithm with quantised action spaces to solve the problem. Experiments show that the proposed approach is able to handle a multi-objective reward comprised of maximising product sales and minimising wastage of perishable products.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑