We propose and show the efficacy of a new method to address generic inverse problems. Inverse modeling is the task whereby one seeks to determine the control parameters of a natural system that produce a given set of observed measurements. Recent work has shown impressive results using deep learning, but we note that there is a trade-off between model performance and computational time. For some applications, the computational time at inference for the best performing inverse modeling method may be overly prohibitive to its use. We present a new method that leverages multiple manifolds as a mixture of backward (e.g., inverse) models in a forward-backward model architecture. These multiple backwards models all share a common forward model, and their training is mitigated by generating training examples from the forward model. The proposed method thus has two innovations: 1) the multiple Manifold Mixture Network (MMN) architecture, and 2) the training procedure involving augmenting backward model training data using the forward model. We demonstrate the advantages of our method by comparing to several baselines on four benchmark inverse problems, and we furthermore provide analysis to motivate its design.
我们研究了高维异质数据分析中统计精度和计算易处理性之间的基本权衡。作为实例,我们研究了稀疏高斯混合模型、稀疏线性回归混合模型和稀疏相位恢复模型。对于这些模型,我们利用一个基于甲骨文的计算模型,建立无故障的计算可行的极大极小下界,量化的最小信号强度的存在所需的任何算法,这是计算上易于处理和统计上准确的。我们的分析表明,计算上可行的极大极小风险和经典的存在显着的差距。这些差距量化了我们在数据异质性存在的情况下为实现计算易处理性而必须付出的统计代价。我们的研究结果涵盖了检测,估计,支持恢复和聚类的问题,此外,解决了Azizyan et al.(2013,2015); Verzelen and Arias-Castro(2017); Cai et al.(2016)的几个问题。有趣的是,我们的研究结果揭示了异构数据分析中一个新的但反直觉的现象,即更多的数据可能会导致更低的计算复杂性。
Inverse Problems for Partial Differential Equations with Jump Discontinuities in Coefficients via Two-Stage Physics-Informed Deep Learning and Statistical Mixture Models
School of Mathematics and Statistics(数学与统计学学院);Northwestern Polytechnical University(西北工业大学);Huazhong University of Science and Technology(华中科技大学);Xiangtan University(湘潭大学);Southern University of Science and Technology(南方科技大学);MOE Key Laboratory for Complexity Science in Aerospace(航空航天复杂科学教育部重点实验室);SandGold AI Research(SandGold AI研究院)
School of Mathematical Sciences, Nankai University, Tianjin, China(南开大学数学科学学院);Courant Institute, New York University, NY(纽约大学Courant研究所);School of Mathematical Sciences, Peking University, Beijing, China(北京大学数学科学学院);Beijing International Center for Mathematical Research, Center for Machine Learning Research, Peking University, Beijing, China(北京大学北京国际数学研究中心、机器学习研究中心)
An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values
University of Sheffield(谢菲尔德大学);Purdue University(普渡大学);University of Science and Technology of China(中国科学技术大学);University of Oulu(奥卢大学);University College London(伦敦大学学院)
Variational Bayesian Methods for a Tree-Structured Stick-Breaking Process Mixture of Gaussians by Application of the Bayes Codes for Context Tree Models
Center for Data Science Waseda University(早稻田大学数据科学中心)