arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.08734math.NAcs.NA
收藏

多级蒙特卡罗学习

Multilevel Monte Carlo learning

Thomas Gerstner, Bastian Harrach, Daniel Roth, Martin Simon

摘要:

在这项工作中,我们研究了函数量的期望值对随机微分方程(ESDs)的解的近似,其中我们用深度神经网络的评估代替Monte Carlo估计。一旦完成神经网络训练,对所得到的逼近函数的评估在计算上是高效的,使得使用深度神经网络来代替昂贵的蒙特卡罗积分是有吸引力的,例如,用于定量金融中的近实时计算。然而,这些如今广泛传播的想法的缺点在于训练合适的神经网络在计算成本方面可能是令人望而却步的。我们在这里通过引入一种多级方法来训练深度神经网络来解决这个缺点。更准确地说,我们将Beck等人介绍的深度学习算法与Giles的多级Monte Carlo路径模拟的思想相结合。这个想法是训练几个神经网络,每个神经网络都有一定的近似质量和计算复杂性,训练数据从所谓的水平估计器计算,由Giles介绍。我们表明,在某些假设下,训练过程中的方差可以通过将大部分计算工作量转移到粗层次的神经网络训练来减少,其中产生训练数据集是非常便宜的,而训练对应于细层次的神经网络只需要有限数量的训练数据集。我们制定的复杂性定理表明,多级的想法确实可以降低计算复杂性。

英文摘要:

In this work, we study the approximation of expected values of functional quantities on the solution of a stochastic differential equation (SDE), where we replace the Monte Carlo estimation with the evaluation of a deep neural network. Once the neural network training is done, the evaluation of the resulting approximating function is computationally highly efficient so that using deep neural networks to replace costly Monte Carlo integration is appealing, e.g., for near real-time computations in quantitative finance. However, the drawback of these nowadays widespread ideas lies in the fact that training a suitable neural network is likely to be prohibitive in terms of computational cost. We address this drawback here by introducing a multilevel approach to the training of deep neural networks. More precisely, we combine the deep learning algorithm introduced by Beck et al. with the idea of multilevel Monte Carlo path simulation of Giles. The idea is to train several neural networks, each having a certain approximation quality and computational complexity, with training data computed from so-called level estimators, introduced by Giles. We show that under certain assumptions, the variance in the training process can be reduced by shifting most of the computational workload to training neural nets at coarse levels where producing the training data sets is comparably cheap, whereas training the neural nets corresponding to the fine levels requires only a limited number of training data sets. We formulate a complexity theorem showing that the multilevel idea can indeed reduce computational complexity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑