arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.02740cs.LGcond-mat.mtrl-sciphysics.app-phphysics.comp-phphysics.data-an
收藏

一种基于信息匹配的最优实验设计和主动学习方法

An information-matching approach to optimal experimental design and active learning

Brigham Young University;Achilles Heel Technologies;SLAC National Accelerator Laboratory(SLAC国家加速器实验室);University of Electronic Science and Technology of China(电子科学与技术大学);University of Minnesota(明尼苏达大学);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室)

Yonatan Kurniawan, Tracianne B. Neilsen, Benjamin L. Francis, Alex M. Stankovic, Mingjian Wen, Ilia Nikiforov, Ellad B. Tadmor, Vasily V. Bulatov, Vincenzo Lordi, Mark K. Transtrum

AI总结:

本文提出基于Fisher信息矩阵的信息匹配准则,用于选择最有信息量的训练数据,以高效学习关键参数并提升预测精度,应用于电力系统、水下声学等不同领域。

摘要:

数学模型的有效性严重依赖于训练数据的质量,但获取足够数据往往昂贵且具有挑战性。许多建模应用仅需推断参数以预测其他感兴趣的量(QoI)。由于模型通常包含许多不可识别(松散)参数,QoIs通常依赖于少量参数组合。因此,我们引入基于Fisher信息矩阵的信息匹配准则,用于从候选池中选择最有信息量的训练数据。该方法确保所选数据包含足够的信息,仅学习需要约束下游QoIs的参数。它被公式化为一个凸优化问题,使其能够扩展到大规模模型和数据集。我们展示了该方法在各种建模问题中的有效性,包括电力系统和水下声学等不同科学领域。最后,我们使用信息匹配作为查询函数,在材料科学应用中实现主动学习循环。在所有这些应用中,我们发现相对少量的最优训练数据可以提供必要的信息,以实现精确预测。这些结果对未来的广泛应用,特别是大规模机器学习模型中的主动学习具有积极影响。

英文摘要:

The efficacy of mathematical models heavily depends on the quality of the training data, yet collecting sufficient data is often expensive and challenging. Many modeling applications require inferring parameters only as a means to predict other quantities of interest (QoI). Because models often contain many unidentifiable (sloppy) parameters, QoIs often depend on a relatively small number of parameter combinations. Therefore, we introduce an information-matching criterion based on the Fisher Information Matrix to select the most informative training data from a candidate pool. This method ensures that the selected data contain sufficient information to learn only those parameters that are needed to constrain downstream QoIs. It is formulated as a convex optimization problem, making it scalable to large models and datasets. We demonstrate the effectiveness of this approach across various modeling problems in diverse scientific fields, including power systems and underwater acoustics. Finally, we use information-matching as a query function within an Active Learning loop for material science applications. In all these applications, we find that a relatively small set of optimal training data can provide the necessary information for achieving precise predictions. These results are encouraging for diverse future applications, particularly active learning in large machine learning models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑