Randomized Approach to Nonlinear Inversion Combining Simultaneous Random and Optimized Sources and Detectors
Virginia Tech(弗吉尼亚理工大学);Tufts University(塔夫茨大学)
Selin Aslan, Eric de Sturler, Misha E. Kilmer
备注:
The algorithm to select optimized sources and detectors and combining these with randomized sources and detectors has been substantially revised from the previous version
In partial differential equations-based (PDE-based) inverse problems with many measurements, many large-scale discretized PDEs must be solved for each evaluation of the misfit or objective function. In the nonlinear case, evaluating the Jacobian requires solving an additional set of systems. This leads to a tremendous computational cost, and this is by far the dominant cost for these problems. Several authors have proposed randomization and stochastic programming techniques to drastically reduce the number of system solves by estimating the objective function using only a few appropriately chosen random linear combinations of the sources. While some have reported good solution quality at a greatly reduced cost, for our problem of interest, diffuse optical tomography, the approach often does not lead to sufficiently accurate solutions.
We propose two improvements. First, to efficiently exploit Newton-type methods, we modify the stochastic estimates to include random linear combinations of detectors, drastically reducing the number of adjoint solves. Second, after solving to a modest tolerance, we compute a few simultaneous sources and detectors that maximize the Frobenius norm of the sampled Jacobian to improve the rate of convergence and obtain more accurate solutions. We complement these optimized simultaneous sources and detectors by random simultaneous sources and detectors constrained to a complementary subspace. Our approach leads to solutions of the same quality as obtained using all sources and detectors but at a greatly reduced computational cost, as the number of large-scale linear systems to be solved is significantly reduced.
Precision-induced Adaptive Randomized Low-Rank Approximation for SVD and Matrix Inversion
Nanjing University of Information Science and Technology(南京信息工程大学);Xi’an Jiaotong University(西安交通大学);Xiamen University(厦门大学);Pengcheng Laboratory(鹏城实验室)
Optimal and scalable methods to approximate the solutions of large-scale Bayesian problems: Theory and application to atmospheric inversions and data assimilation
Matrix probing: a randomized preconditioner for the wave-equation Hessian
Department of Mathematics, MIT(麻省理工学院数学系);Institute for Computational Mathematics and Engineering, Stanford(斯坦福大学计算数学与工程研究所);Applied Mathematics Department, Université catholique de Louvain(天主教鲁汶大学应用数学系);Total SA, Exploration & Production(道达尔公司勘探与生产部);Courant Institute of Mathematical Sciences, NYU(纽约大学库朗数学科学研究所)
Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra
University of Pavia(帕维亚大学);Department of Mathematics(数学系);Department of Civil Engineering and Architecture(土木工程与建筑系);Institut Camille Jordan, Lyon 1 Université(让·乔丹研究所,里昂1大学)
Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization
Télécom ParisTech(巴黎电信学院);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);University of Edinburgh(爱丁堡大学);Moscow Institute of Physics and Technology(莫斯科物理技术学院);École polytechnique fédérale de Lausanne (EPFL)(洛桑联邦理工学院)