arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.04022cs.CVcs.AIcs.LG
收藏

学习非线性不变量用于无监督分布外检测

Learning Non-Linear Invariants for Unsupervised Out-of-Distribution Detection

University of Bern(伯尔尼大学)

Lars Doorenbos, Raphael Sznitman, Pablo Márquez-Neila

AI总结:

本文针对无监督分布外检测中仿射不变量表达能力受限的问题,提出基于类归一化流架构学习非线性不变量的框架,并在大规模基准和表格数据上取得最先进结果。

摘要:

深度学习模型无法处理来自未见分布的数据,这引发了人们对无监督分布外(U-OOD)检测的极大兴趣,因为它对于可靠的深度学习模型至关重要。尽管受到了相当多的关注,但具有理论动机的方法却少之又少,大多数方法都建立在某种形式的启发式之上。最近,U-OOD 在数据不变量的背景下被形式化,使人们能够更清楚地理解如何刻画 U-OOD,并且利用仿射不变量的方法已在大规模基准上取得了最先进的结果。然而,对仿射不变量的限制阻碍了该方法的表达能力。在这项工作中,我们将仿射不变量公式推广到更一般的情形,并提出一个由类似归一化流的架构组成的框架,该架构能够学习非线性不变量。我们的新方法在广泛的 U-OOD 基准上取得了最先进的结果,并且我们证明了它可进一步适用于表格数据。最后,我们表明我们的方法具有与基于仿射不变量的方法相同的理想性质。

英文摘要:

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable attention, theoretically-motivated approaches are few and far between, with most methods building on top of some form of heuristic. Recently, U-OOD was formalized in the context of data invariants, allowing a clearer understanding of how to characterize U-OOD, and methods leveraging affine invariants have attained state-of-the-art results on large-scale benchmarks. Nevertheless, the restriction to affine invariants hinders the expressiveness of the approach. In this work, we broaden the affine invariants formulation to a more general case and propose a framework consisting of a normalizing flow-like architecture capable of learning non-linear invariants. Our novel approach achieves state-of-the-art results on an extensive U-OOD benchmark, and we demonstrate its further applicability to tabular data. Finally, we show our method has the same desirable properties as those based on affine invariants.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑