arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.03380math.NAcs.NA
收藏

由ANOVA分解初始化的张量训练格式的黑箱近似

Black box approximation in the tensor train format initialized by ANOVA decomposition

Andrei Chertkov, Gleb Ryzhakov, Ivan Oseledets

摘要:

代理模型可以降低具有未知内部结构(黑盒)的多变量函数的计算成本。在离散公式中,代理建模相当于从其元素的一小部分恢复多维数组(张量)。张量训练(TT)格式的交替最小二乘(ALS)算法是在从给定训练集(即,张量完成问题)。TT-ALS允许获得张量的低参数表示,其不受维数灾难的影响,并且可以用于快速计算任意张量索引处的值或使用黑盒(积分等)有效实现代数运算。然而,为了在存在对训练数据的大小的限制的情况下获得高精度,初始近似的良好选择是必不可少的。在这项工作中,我们构建了TT格式的ANOVA表示,并将其用作TT-ALS算法的初始近似。一些多维模型问题,包括参数偏微分方程的数值计算,表明我们的方法的一个显着的优势,常用的随机初始近似。对于所有考虑的模型问题,我们得到了至少一个数量级的数量级的黑盒的请求相同数量的精度增加。所提出的方法是非常普遍的,可以应用于广泛的现实世界的代理建模和机器学习问题。

英文摘要:

Surrogate models can reduce computational costs for multivariable functions with an unknown internal structure (black boxes). In a discrete formulation, surrogate modeling is equivalent to restoring a multidimensional array (tensor) from a small part of its elements. The alternating least squares (ALS) algorithm in the tensor train (TT) format is a widely used approach to effectively solve this problem in the case of non-adaptive tensor recovery from a given training set (i.e., tensor completion problem). TT-ALS allows obtaining a low-parametric representation of the tensor, which is free from the curse of dimensionality and can be used for fast computation of the values at arbitrary tensor indices or efficient implementation of algebra operations with the black box (integration, etc.). However, to obtain high accuracy in the presence of restrictions on the size of the train data, a good choice of initial approximation is essential. In this work, we construct the ANOVA representation in the TT-format and use it as an initial approximation for the TT-ALS algorithm. The performed numerical computations for a number of multidimensional model problems, including the parametric partial differential equation, demonstrate a significant advantage of our approach for the commonly used random initial approximation. For all considered model problems we obtained an increase in accuracy by at least an order of magnitude with the same number of requests to the black box. The proposed approach is very general and can be applied in a wide class of real-world surrogate modeling and machine learning problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑