arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.10364math.NAcs.NA
收藏

基于自适应稀疏网格Quadrature的牛顿型方法求解随机最优化

Solving Stochastic Optimization by Newton-type methods with Dimension-Adaptive Sparse Grid Quadrature

Yuancheng Zhou

摘要:

随机最优化问题最小化随机费用函数的期望。我们采用先优化后离散的方法来解决随机优化问题。在我们的方法中,需要精确的求积方法来计算实际上是积分的目标、梯度或Hessian。当问题是高维的时候,我们应用维数自适应的稀疏网格求积来近似这些积分。自适应稀疏网格求积方法在计算光滑被积函数的积分时具有较高的精度和效率。它是经典稀疏网格方法的一种推广,根据其重要性细化不同的维度。我们表明,维数自适应稀疏网格求积有更好的性能,在优化后离散的方法比离散后优化的方法。

英文摘要:

Stochastic optimisation problems minimise expectations of random cost functions. We use 'optimise then discretise' method to solve stochastic optimisation. In our approach, accurate quadrature methods are required to calculate the objective, gradient or Hessian which are in fact integrals. We apply the dimension-adaptive sparse grid quadrature to approximate these integrals when the problem is high dimensional. Dimension-adaptive sparse grid quadrature shows high accuracy and efficiency in computing an integral with a smooth integrand. It is a kind of generalisation of the classical sparse grid method, which refines different dimensions according to their importance. We show that the dimension-adaptive sparse grid quadrature has better performance in the optimise then discretise' method than the 'discretise then optimise' method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑