arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.04170stat.MLcs.LGstat.COstat.ME
收藏

基于张量序列和梯度降维的可扩展条件深度逆Rosenblatt输运

Scalable conditional deep inverse Rosenblatt transports using tensor-trains and gradient-based dimension reduction

Monash University(莫纳什大学);University of Bath(巴斯大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔国立理工学院)

Tiangang Cui, Sergey Dolgov, Olivier Zahm

摘要:

我们提出了一种新的离线-在线方法,以减轻计算负担的表征后验随机变量的统计学习。在离线阶段,所提出的方法学习的联合规律的参数随机变量和可观察的随机变量的张量列车(TT)格式。在在线阶段,所得到的保序条件传输可以实时地描述新观测数据下的后验随机变量。与现有的归一化流技术相比,该方法依赖于函数逼近,并进行了全面的性能分析。函数近似的观点也使我们能够进一步扩展的能力,运输地图在具有挑战性的问题与高维观测和高维参数。一方面,我们提出了新的算法来重新排序和/或重新参数化变量,以提高TT的近似能力。另一方面,我们将基于TT的传输图和参数重新排序/重新参数化集成到分层组合中,以进一步提高所得到的传输图的性能。我们证明了所提出的方法在常微分方程(ODE)和偏微分方程(PDE)的各种统计学习任务的效率。

英文摘要:

We present a novel offline-online method to mitigate the computational burden of the characterization of posterior random variables in statistical learning. In the offline phase, the proposed method learns the joint law of the parameter random variables and the observable random variables in the tensor-train (TT) format. In the online phase, the resulting order-preserving conditional transport can characterize the posterior random variables given newly observed data in real time. Compared with the state-of-the-art normalizing flow techniques, the proposed method relies on function approximation and is equipped with a thorough performance analysis. The function approximation perspective also allows us to further extend the capability of transport maps in challenging problems with high-dimensional observations and high-dimensional parameters. On the one hand, we present novel heuristics to reorder and/or reparametrize the variables to enhance the approximation power of TT. On the other hand, we integrate the TT-based transport maps and the parameter reordering/reparametrization into layered compositions to further improve the performance of the resulting transport maps. We demonstrate the efficiency of the proposed method on various statistical learning tasks in ordinary differential equations (ODEs) and partial differential equations (PDEs).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑