arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.04563cs.LGmath.OC
收藏

失真风险度量优化的随机逼近方法

Stochastic Approximation Methods for Distortion Risk Measure Optimization

Guanghua School of Management Peking University(北京大学光华管理学院);School of Business and Economics Vrije Universiteit Amsterdam(荷兰阿姆斯特丹自由大学商学院);Department of Applied Mathematics and Statistics State University of New York at Stony Brook(纽约州立大学石溪分校应用数学与统计学系);Guanghua School of Management School of Artificial Intelligence for Science Peking University(北京大学光华管理学院人工智能科学学院);Xiangjiang Laboratory(湘江实验室)

Jinyang Jiang, Bernd Heidergott, Jiaqiao Hu, Yijie Peng

AI总结:

本文提出基于DM和QF双对偶表示的梯度下降算法优化失真风险度量,证明收敛速率,并在稳健投资组合和深度强化学习库存管理中验证有效性。

摘要:

失真风险度量(DRMs)在决策中捕捉风险偏好,并作为管理不确定性的通用准则。本文基于两种对偶表示,即失真度量(DM)形式和分位数函数(QF)形式,提出了用于DRM优化的梯度下降算法。DM形式采用三时间尺度算法来跟踪分位数、计算其梯度并更新决策变量,利用广义似然比和基于核的密度估计。QF形式提供了一种更简单的两时间尺度方法,避免了复杂的分位数梯度估计需求。一种混合形式整合了两种方法,在失真函数跳跃附近应用DM形式以获得稳健性能,在平滑区域应用QF形式以提高效率。本文提供了所提出算法的强收敛性和收敛速率的证明。特别地,DM形式达到了$O(k^{-4/7})$的最优速率,而QF形式达到了更快的$O(k^{-2/3})$速率。数值实验证实了它们的有效性,并在稳健投资组合选择任务中展示了相对于基线的显著改进。该方法的可扩展性通过集成到深度强化学习中进一步得到说明。具体而言,开发了一种基于DRM的近端策略优化算法,并将其应用于多级动态库存管理,展示了其实用适用性。

英文摘要:

Distortion Risk Measures (DRMs) capture risk preferences in decision-making and serve as general criteria for managing uncertainty. This paper proposes gradient descent algorithms for DRM optimization based on two dual representations: the Distortion-Measure (DM) form and Quantile-Function (QF) form. The DM-form employs a three-timescale algorithm to track quantiles, compute their gradients, and update decision variables, utilizing the Generalized Likelihood Ratio and kernel-based density estimation. The QF-form provides a simpler two-timescale approach that avoids the need for complex quantile gradient estimation. A hybrid form integrates both approaches, applying the DM-form for robust performance around distortion function jumps and the QF-form for efficiency in smooth regions. Proofs of strong convergence and convergence rates for the proposed algorithms are provided. In particular, the DM-form achieves an optimal rate of $O(k^{-4/7})$, while the QF-form attains a faster rate of $O(k^{-2/3})$. Numerical experiments confirm their effectiveness and demonstrate substantial improvements over baselines in robust portfolio selection tasks. The method's scalability is further illustrated through integration into deep reinforcement learning. Specifically, a DRM-based Proximal Policy Optimization algorithm is developed and applied to multi-echelon dynamic inventory management, showcasing its practical applicability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑