arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.09301cs.LGcs.CV
收藏

OpenOOD v1.5:用于分布外检测的增强基准

OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detection

Duke University(杜克大学);Nanyang Technological University(南洋理工大学);Beijing University of Posts and Telecommunications(北京邮电大学);SenseTime Research(商汤科技研究院);Duke Kunshan University(昆山杜克大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);The Australian National University(澳大利亚国立大学);EPFL(洛桑联邦理工学院)

Jingyang Zhang, Jingkang Yang, Pengyun Wang, Haoqi Wang, Yueqian Lin, Haoran Zhang, Yiyou Sun, Xuefeng Du, Yixuan Li, Ziwei Liu, Yiran Chen, Hai Li

AI总结:

OpenOOD v1.5提出增强的OOD检测基准,支持ImageNet大规模数据集和CLIP等基础模型,覆盖全谱系分布偏移,提供标准化评估与深入分析。

摘要:

分布外(OOD)检测对于开放世界智能系统的可靠运行至关重要。尽管越来越多的OOD检测方法不断涌现,但评估不一致性给跟踪该领域的进展带来了挑战。OpenOOD v1启动了OOD检测评估的统一化,但在可扩展性和范围方面存在局限。为此,本文提出了OpenOOD v1.5,这是对其前身的一次重大改进,确保在大规模下对OOD检测方法进行准确且标准化的评估。值得注意的是,OpenOOD v1.5将评估能力扩展到大规模数据集(ImageNet)和基础模型(例如CLIP和DINOv2),并将其范围扩大到研究全谱系OOD检测,该检测同时考虑语义和协变量分布偏移。这项工作还基于全面的实验结果提供了深入分析和见解,从而丰富了OOD检测方法论的知识库。凭借这些增强,OpenOOD v1.5旨在推动进步,并为OOD检测研究提供更强大、更全面的评估基准。

英文摘要:

Out-of-Distribution (OOD) detection is critical for the reliable operation of open-world intelligent systems. Despite the emergence of an increasing number of OOD detection methods, the evaluation inconsistencies present challenges for tracking the progress in this field. OpenOOD v1 initiated the unification of the OOD detection evaluation but faced limitations in scalability and scope. In response, this paper presents OpenOOD v1.5, a significant improvement from its predecessor that ensures accurate and standardized evaluation of OOD detection methodologies at large scale. Notably, OpenOOD v1.5 extends its evaluation capabilities to large-scale data sets (ImageNet) and foundation models (e.g., CLIP and DINOv2), and expands its scope to investigate full-spectrum OOD detection which considers semantic and covariate distribution shifts at the same time. This work also contributes in-depth analysis and insights derived from comprehensive experimental results, thereby enriching the knowledge pool of OOD detection methodologies. With these enhancements, OpenOOD v1.5 aims to drive advancements and offer a more robust and comprehensive evaluation benchmark for OOD detection research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑