arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2208.00765q-fin.CPcs.AI
收藏

强化学习求解最优停时问题:在金融期权中的应用

Solving the optimal stopping problem with reinforcement learning: an application in financial option exercise

Universidade de São Paulo(圣保罗大学);Fundacao Getulio Vargas(瓦加斯基金会)

Leonardo Kanashiro Felizardo, Elia Matsumoto, Emilio Del-Moral-Hernandez

摘要:

最优停时问题是一类具有特定约束配置的决策问题。它与金融和管理等各种现实应用相关。为了解决最优停时的问题,国家的最先进的动态规划算法,如最小二乘蒙特卡罗(LSMC),采用。这种类型的算法依赖于仅使用标的资产的最后价格作为状态表示的路径模拟。此外,LSMC正在考虑期权估值,其中风险中性概率可以用来解释不确定性。然而,一般的最优停时问题的目标可能不适合的LSMC显示自相关价格的要求。我们采用数据驱动的方法,使用蒙特卡罗模拟训练和测试人工神经网络(ANN)来解决最优停时的问题。使用人工神经网络解决决策问题并不是全新的。我们提出了一种不同的架构,使用卷积神经网络(CNN)来处理当我们将整个价格历史转换为马尔可夫状态时出现的维数问题。我们目前的实验表明,我们提出的架构改善了在特定的模拟时间序列函数集的结果比以前的实现。最后,我们使用我们的方法来比较金融期权问题的最优执行与LSMC算法。我们的实验表明,我们的方法可以捕捉更准确的运动机会相比,LSMC。我们有显著更高的(974\%以上的改善)预期回报,从这些行使政策下的许多蒙特卡罗模拟,使用真实世界的回报数据库的样本(测试)数据。

英文摘要:

The optimal stopping problem is a category of decision problems with a specific constrained configuration. It is relevant to various real-world applications such as finance and management. To solve the optimal stopping problem, state-of-the-art algorithms in dynamic programming, such as the least-squares Monte Carlo (LSMC), are employed. This type of algorithm relies on path simulations using only the last price of the underlying asset as a state representation. Also, the LSMC was thinking for option valuation where risk-neutral probabilities can be employed to account for uncertainty. However, the general optimal stopping problem goals may not fit the requirements of the LSMC showing auto-correlated prices. We employ a data-driven method that uses Monte Carlo simulation to train and test artificial neural networks (ANN) to solve the optimal stopping problem. Using ANN to solve decision problems is not entirely new. We propose a different architecture that uses convolutional neural networks (CNN) to deal with the dimensionality problem that arises when we transform the whole history of prices into a Markovian state. We present experiments that indicate that our proposed architecture improves results over the previous implementations under specific simulated time series function sets. Lastly, we employ our proposed method to compare the optimal exercise of the financial options problem with the LSMC algorithm. Our experiments show that our method can capture more accurate exercise opportunities when compared to the LSMC. We have outstandingly higher (above 974\% improvement) expected payoff from these exercise policies under the many Monte Carlo simulations that used the real-world return database on the out-of-sample (test) data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑