An information-matching approach to optimal experimental design and active learning
Brigham Young University;Achilles Heel Technologies;SLAC National Accelerator Laboratory(SLAC国家加速器实验室);University of Electronic Science and Technology of China(电子科学与技术大学);University of Minnesota(明尼苏达大学);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室)
Yonatan Kurniawan, Tracianne B. Neilsen, Benjamin L. Francis, Alex M. Stankovic, Mingjian Wen, Ilia Nikiforov, Ellad B. Tadmor, Vasily V. Bulatov, Vincenzo Lordi, Mark K. Transtrum
The efficacy of mathematical models heavily depends on the quality of the training data, yet collecting sufficient data is often expensive and challenging. Many modeling applications require inferring parameters only as a means to predict other quantities of interest (QoI). Because models often contain many unidentifiable (sloppy) parameters, QoIs often depend on a relatively small number of parameter combinations. Therefore, we introduce an information-matching criterion based on the Fisher Information Matrix to select the most informative training data from a candidate pool. This method ensures that the selected data contain sufficient information to learn only those parameters that are needed to constrain downstream QoIs. It is formulated as a convex optimization problem, making it scalable to large models and datasets. We demonstrate the effectiveness of this approach across various modeling problems in diverse scientific fields, including power systems and underwater acoustics. Finally, we use information-matching as a query function within an Active Learning loop for material science applications. In all these applications, we find that a relatively small set of optimal training data can provide the necessary information for achieving precise predictions. These results are encouraging for diverse future applications, particularly active learning in large machine learning models.
Cluster-Aware Matching via Laplacian Optimal Transport
Department of Applied Mathematics, Tel Aviv University(特拉维夫大学应用数学系);Department of Statistics, Columbia University(哥伦比亚大学统计系);Department of Statistics, University of Chicago(芝加哥大学统计系)
Inverse design of bespoke interatomic potentials via active learning by information-matching
Department of Physics and Astronomy, Brigham Young University(物理学与天文学系, Brigham Young 大学);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);Department of Aerospace Engineering and Mechanics, University of Minnesota(航空航天工程与力学系,明尼苏达大学);Department of Materials Science and Engineering, University of California(材料科学与工程系,加州大学);Cross Stream Consulting(Cross Stream 咨询)
Improving Probabilistic Diffusion Models With Optimal Diagonal Covariance Matching
Imperial College London(伦敦帝国学院);University College London(伦敦大学学院);University of Manchester(曼彻斯特大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Tubingen(蒂宾根大学);IMPRS-IS(马克斯·普朗克智能系统研究所国际马克斯·普朗克研究学院)