arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.06331cs.LG
收藏

知情方程学习

Informed Equation Learning

ETAS GmbH, Bosch Group(博世集团ETAS有限公司);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Tübingen(图宾根大学)

Matthias Werner, Andrej Junginger, Philipp Hennig, Georg Martius

摘要:

将数据提炼成紧凑且可解释的分析方程是科学的目标之一。相反,当代监督机器学习方法大多产生从输入到输出的非结构化和密集的映射。特别是在深度学习中,这种属性归因于简单标准链接函数的通用性质。为了学习方程而不是地图,标准的非线性可以用原子函数的结构化构建块来代替。然而,没有强大的先验知识的稀疏性和结构,表示的复杂性和数值条件限制了这种直接的方法。为了适应科学和工程中的现实环境,我们提出了一个知情的方程学习系统。它提供了一种方法来结合专家知识,什么是允许或禁止的方程组件,以及一个域相关的结构稀疏先验。然后,我们的系统利用一种强大的方法来学习具有奇异性的原子函数的方程,例如对数和除法。我们展示了来自工程领域的几个人工和真实世界的实验,在这些实验中,我们的系统学习了具有高预测能力的可解释模型。

英文摘要:

Distilling data into compact and interpretable analytic equations is one of the goals of science. Instead, contemporary supervised machine learning methods mostly produce unstructured and dense maps from input to output. Particularly in deep learning, this property is owed to the generic nature of simple standard link functions. To learn equations rather than maps, standard non-linearities can be replaced with structured building blocks of atomic functions. However, without strong priors on sparsity and structure, representational complexity and numerical conditioning limit this direct approach. To scale to realistic settings in science and engineering, we propose an informed equation learning system. It provides a way to incorporate expert knowledge about what are permitted or prohibited equation components, as well as a domain-dependent structured sparsity prior. Our system then utilizes a robust method to learn equations with atomic functions exhibiting singularities, as e.g. logarithm and division. We demonstrate several artificial and real-world experiments from the engineering domain, in which our system learns interpretable models of high predictive power.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑