arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.05058cs.LGstat.ML
收藏

不变表示的稳健评估

A robust assessment for invariant representations

University of Alberta(阿尔伯塔大学);the Chinese University of Hong Kong(香港中文大学)

Wenlu Tang, Zicheng Liu

AI总结:

本文针对基于 IRM 的表示缺乏直接不变性能评估的问题,利用似然比连接跨环境条件期望,提出稳健评估准则,并通过理论与数值实验验证其有效性。

摘要:

机器学习模型的性能可能会受到数据随时间变化的影响。应对这一挑战的一种有前景的方法是不变学习,其特别关注一种被称为不变风险最小化(IRM)的方法。该技术旨在识别一种稳定的数据表示,使其在分布外(OOD)数据上仍然有效。尽管已有大量研究开发了适应数据增强场景的基于 IRM 的方法,但直接评估这些表示在不同条件下保持其不变性能的程度所受到的关注仍然有限。在本文中,我们提出了一种评估不变性能的新方法,专门针对基于 IRM 的方法设计。我们通过似然比,在不同环境下不变预测器的条件期望之间建立了桥梁。我们提出的准则为评估不变性能提供了稳健基础。我们以理论支持验证了该方法,并通过大量数值研究证明了其有效性。这些实验说明了我们的方法如何评估各种表示技术的不变性能。

英文摘要:

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM). This technique aims to identify a stable data representation that remains effective with out-of-distribution (OOD) data. While numerous studies have developed IRM-based methods adaptive to data augmentation scenarios, there has been limited attention on directly assessing how well these representations preserve their invariant performance under varying conditions. In our paper, we propose a novel method to evaluate invariant performance, specifically tailored for IRM-based methods. We establish a bridge between the conditional expectation of an invariant predictor across different environments through the likelihood ratio. Our proposed criterion offers a robust basis for evaluating invariant performance. We validate our approach with theoretical support and demonstrate its effectiveness through extensive numerical studies.These experiments illustrate how our method can assess the invariant performance of various representation techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑