arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.08602q-fin.RMcs.CEcs.LG
收藏

面向美式看跌期权对冲的深度强化学习优化

Optimizing Deep Reinforcement Learning for American Put Option Hedging

University of Toronto(多伦多大学);Ernst & Young LLP(安永会计师事务所)

Reilly Pickard, F. Wredenhagen, Y. Lawryshyn

AI总结:

本文针对美式看跌期权对冲问题,优化深度强化学习超参数并提出周度重训练智能体的方法,验证其在不同交易成本下均优于传统Black-Scholes Delta方法,具备实际应用价值。

摘要:

本文对深度强化学习(Deep Reinforcement Learning, DRL)用于美式期权对冲的现有研究做出补充。研究首先探究超参数对对冲性能的影响,考察的超参数包括学习率、训练回合数、神经网络架构、训练步数以及交易成本惩罚函数。结果表明,需避免某些超参数组合,例如高学习率搭配大量训练回合,或是低学习率搭配少量训练回合,同时强调采用中等取值对于获得最优结果的重要性。此外,本文提醒需避免训练步数过多以防止不稳定,并证明二次交易成本惩罚函数的效果优于线性惩罚函数。\n随后,本研究在Pickard等人(2024)的工作基础上进行拓展,该研究采用切比雪夫插值期权定价方法,结合经市场校准的随机波动率模型来训练DRL智能体。尽管Pickard等人(2024)的结果显示这类DRL智能体在实证资产路径上表现良好,本研究提出了一种新方法:以周为间隔,用新校准的随机波动率模型训练新的智能体。结果表明,使用每周市场数据重新训练的DRL智能体,性能优于仅在出售日训练的智能体。此外,本文证明在交易成本为1%和3%的情况下,单次训练和每周训练的DRL智能体表现均优于Black-Scholes Delta方法。这一实际相关性表明,从业者可利用易得的市场数据训练DRL智能体,以有效对冲其投资组合中的期权。

英文摘要:

This paper contributes to the existing literature on hedging American options with Deep Reinforcement Learning (DRL). The study first investigates hyperparameter impact on hedging performance, considering learning rates, training episodes, neural network architectures, training steps, and transaction cost penalty functions. Results highlight the importance of avoiding certain combinations, such as high learning rates with a high number of training episodes or low learning rates with few training episodes and emphasize the significance of utilizing moderate values for optimal outcomes. Additionally, the paper warns against excessive training steps to prevent instability and demonstrates the superiority of a quadratic transaction cost penalty function over a linear version. This study then expands upon the work of Pickard et al. (2024), who utilize a Chebyshev interpolation option pricing method to train DRL agents with market calibrated stochastic volatility models. While the results of Pickard et al. (2024) showed that these DRL agents achieve satisfactory performance on empirical asset paths, this study introduces a novel approach where new agents at weekly intervals to newly calibrated stochastic volatility models. Results show DRL agents re-trained using weekly market data surpass the performance of those trained solely on the sale date. Furthermore, the paper demonstrates that both single-train and weekly-train DRL agents outperform the Black-Scholes Delta method at transaction costs of 1% and 3%. This practical relevance suggests that practitioners can leverage readily available market data to train DRL agents for effective hedging of options in their portfolios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑