arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.10176cs.LGcs.CV
收藏

全面的分布外检测改进

Comprehensive OOD Detection Improvements

Booz Allen Hamilton(博思艾伦汉密尔顿公司);University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校);Air Force Research Laboratory(空军研究实验室)

Anish Lakkapragada, Amol Khanna, Edward Raff, Nathan Inkawhich

AI总结:

本文同时改进基于表示和基于logit的OOD检测方法,提出特征嵌入降维加速方案及修正DICE缺陷的DICE-COL,在OpenOODv1.5上取得最先进性能。

摘要:

随着机器学习在具有重大影响的决策中日益普及,识别推理数据何时超出模型预期的输入分布对于为预测提供上下文至关重要。分布外(OOD)检测方法正是为此任务而设计。此类方法可根据其分别利用模型的嵌入还是预测进行OOD检测,划分为基于表示的方法或基于logit的方法。与大多数仅关注其中一类方法的论文不同,我们同时处理这两类方法。我们在基于表示的方法中对特征嵌入应用降维,以实现时间加速和性能提升。此外,我们提出了DICE-COL,这是对流行的基于logit的方法Directed Sparsification(DICE)的一种改进,解决了一个未被注意到的缺陷。我们在OpenOODv1.5基准框架上证明了我们方法的有效性,它们显著提升了性能并取得了最先进的结果。

英文摘要:

As machine learning becomes increasingly prevalent in impactful decisions, recognizing when inference data is outside the model's expected input distribution is paramount for giving context to predictions. Out-of-distribution (OOD) detection methods have been created for this task. Such methods can be split into representation-based or logit-based methods from whether they respectively utilize the model's embeddings or predictions for OOD detection. In contrast to most papers which solely focus on one such group, we address both. We employ dimensionality reduction on feature embeddings in representation-based methods for both time speedups and improved performance. Additionally, we propose DICE-COL, a modification of the popular logit-based method Directed Sparsification (DICE) that resolves an unnoticed flaw. We demonstrate the effectiveness of our methods on the OpenOODv1.5 benchmark framework, where they significantly improve performance and set state-of-the-art results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑