arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.13103cs.LGstat.ML
收藏

面向理论驱动模型可信估计的自适应数据驱动模型的深灰箱建模

Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Models

Geneva School of Business Administration(日内瓦工商管理学院);University of Applied Sciences and Arts Western Switzerland (HES-SO)(瑞士西部应用科学与艺术大学(HES-SO))

Naoya Takeishi, Alexandros Kalousis

摘要:

深度神经网络和理论驱动模型的结合,我们称之为深度灰盒建模,由于理论支柱,在某种程度上可以内在地解释。深度灰盒模型通常通过正则化风险最小化来学习,以防止理论驱动的部分被深度神经网络覆盖和忽略。然而,通过不加批判地优化正则化器获得的理论驱动部分的估计很难是可信的,当我们不确定什么正则化器适合于给定的数据,这可能会损害可解释性。为了对理论驱动部分进行可信的估计,我们应该分析正则化子的行为,以比较不同的候选者并证明特定的选择。在本文中,我们提出了一个框架,使我们能够分析正则化器的行为经验与神经网络的架构和训练目标略有变化。

英文摘要:

The combination of deep neural nets and theory-driven models, which we call deep grey-box modeling, can be inherently interpretable to some extent thanks to the theory backbone. Deep grey-box models are usually learned with a regularized risk minimization to prevent a theory-driven part from being overwritten and ignored by a deep neural net. However, an estimation of the theory-driven part obtained by uncritically optimizing a regularizer can hardly be trustworthy when we are not sure what regularizer is suitable for the given data, which may harm the interpretability. Toward a trustworthy estimation of the theory-driven part, we should analyze regularizers' behavior to compare different candidates and to justify a specific choice. In this paper, we present a framework that enables us to analyze a regularizer's behavior empirically with a slight change in the neural net's architecture and the training objective.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑