arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.04450cs.CVcs.LG
收藏

如何利用超球面嵌入进行分布外检测?

How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?

University of Wisconsin-Madison(威斯康星大学麦迪逊分校);Meta

Yifei Ming, Yiyou Sun, Ousmane Dia, Yixuan Li

AI总结:

本文提出CIDER框架,通过在超球面空间中联合优化分散损失和紧凑性损失增强ID与OOD样本的可分性,显著提升OOD检测性能,在FPR95上超越最新方法19.36%。

摘要:

分布外(OOD)检测是实现可靠机器学习的一项关键任务。表示学习的最新进展催生了基于距离的OOD检测方法,即当测试样本与分布内(ID)类别的中心点或原型相对较远时,将其检测为OOD。然而,先前的方法直接采用现成的对比损失,这些损失足以对ID样本进行分类,但在测试输入包含OOD样本时并非最优设计。在本工作中,我们提出了CIDER,一种利用超球面嵌入进行OOD检测的新型表示学习框架。CIDER联合优化两个损失以增强ID-OOD可分性:一个分散损失,用于增大不同类别原型之间的角度距离;以及一个紧凑性损失,用于鼓励样本靠近其类别原型。我们分析并建立了OOD检测性能与超球面空间中嵌入特性之间此前未被探索的关系,并证明了分散性和紧凑性的重要性。CIDER取得了优越的性能,在FPR95指标上比最新的竞争对手高出19.36%。代码可在 https://github.com/deeplearning-wisc/cider 获取。

英文摘要:

Out-of-distribution (OOD) detection is a critical task for reliable machine learning. Recent advances in representation learning give rise to distance-based OOD detection, where testing samples are detected as OOD if they are relatively far away from the centroids or prototypes of in-distribution (ID) classes. However, prior methods directly take off-the-shelf contrastive losses that suffice for classifying ID samples, but are not optimally designed when test inputs contain OOD samples. In this work, we propose CIDER, a novel representation learning framework that exploits hyperspherical embeddings for OOD detection. CIDER jointly optimizes two losses to promote strong ID-OOD separability: a dispersion loss that promotes large angular distances among different class prototypes, and a compactness loss that encourages samples to be close to their class prototypes. We analyze and establish the unexplored relationship between OOD detection performance and the embedding properties in the hyperspherical space, and demonstrate the importance of dispersion and compactness. CIDER establishes superior performance, outperforming the latest rival by 19.36% in FPR95. Code is available at https://github.com/deeplearning-wisc/cider.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑