arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.06201cs.AI
收藏

学习补货:面向医药供应链动态库存管理的混合深度强化学习

Learning to replenish: A hybrid deep reinforcement learning for dynamic inventory management in the pharmaceutical supply chains

ABV-Indian Institute of Information Technology and Management(ABV印度信息技术与管理学院)

Amandeep Kaur, Gyan Prakash

AI总结:

针对医药供应链中需求不确定和前置时间变化导致的库存管理难题,提出一种混合异步优势演员评论家分布式近端策略优化(A3C DPPO)算法,实现连续动作空间下的最优补货策略,降低库存成本并提高服务水平。

摘要:

医药供应链(PSCs)因不可预测的需求模式和与补货相关的可变前置时间,在库存管理(IM)方面面临挑战。药品的有限保质期进一步加剧了这种复杂性,需要在充足库存和最小浪费之间取得微妙的平衡。这些相互交织的因素构成了一个复杂的优化问题,需要复杂的库存策略来确保产品可用性和PSC效率。本研究旨在为医药产品开发一种最优库存补货策略,能够处理由不确定需求和可变PSC条件产生的随机性。目标是最大化PSC的盈利能力,同时保持较高的患者服务水平。我们将问题建模为马尔可夫决策过程,并提出一种深度强化学习(DRL)方法,具体为混合异步优势演员评论家分布式近端策略优化(A3C DPPO)算法。该A3C DPPO算法针对IM中固有的连续动作空间进行了定制。数值结果表明,所提算法在动态场景下自适应更新库存补货策略,与各种基准相比,实现了更低的库存成本。我们还使用真实药品库存数据进行了数值验证,以确认所提算法的实际可行性。

英文摘要:

Pharmaceutical supply chains (PSCs) struggle with inventory management (IM) due to unpredictable demand patterns and variable lead times associated with restocking. This complexity is further compounded by the finite shelf lives of pharmaceutical products, which necessitate a delicate balance between adequate stock and minimal waste. These intertwined factors create a complex optimization problem that requires sophisticated inventory strategies to ensure both product availability and PSC efficiency. This study aims to develop an optimal inventory replenishment policy for pharmaceutical products that can handle the stochasticity arising from uncertain demand and variable PSC conditions. The objective is to maximize the profitability of the PSC while maintaining a high patient service level. We formulate the problem as a Markov decision process and propose a deep reinforcement learning (DRL) approach, specifically, a hybrid asynchronous advantage actor critic distributed proximal policy optimization (A3C DPPO)algorithm. The A3C DPPO algorithm is tailored to handle the continuous action space inherent in IM. The numerical results demonstrate that the proposed algorithm adaptively updates the inventory replenishment strategy under dynamic scenarios, resulting in lower inventory costs compared to various benchmarks. We also conduct numerical validation using real-world pharmaceutical inventory data to confirm the practical feasibility of the proposed algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑