arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.08067cs.CVcs.LG
收藏

基于One-vs-Rest网络的开集识别深度概率模型

One-vs-Rest Network-based Deep Probability Model for Open Set Recognition

Yonsei University(延世大学)

Jaeyeon Jang, Chang Ouk Kim

摘要:

在训练过程中看不到的未知示例经常出现在现实世界的计算机视觉任务中,智能自学习系统应该能够区分已知和未知示例。开集识别,解决了这个问题,已经研究了大约十年。然而,传统的基于深度神经网络(DNN)的开集识别方法缺乏识别后分数分析的基础。在本文中,我们提出了一种DNN结构,其中多个one-vs-rest sigmoid网络跟随卷积神经网络特征提取器。一个一对休息的网络,它是由整流的线性单位激活函数的隐藏层和一个单一的sigmoid目标类输出节点,可以最大限度地提高能力,从不匹配的例子学习信息。此外,该网络产生了一个复杂的非线性特征到输出的映射,在特征空间中是可解释的。通过引入基于极值理论的校准技术,非线性和可解释的映射提供了一个基础良好的类成员概率模型。我们的实验表明,one-vs-rest网络可以为未知的示例提供比常用的SoftMax层更多的信息隐藏表示。此外,所提出的概率模型在开集分类场景中优于最先进的方法。

英文摘要:

Unknown examples that are unseen during training often appear in real-world computer vision tasks, and an intelligent self-learning system should be able to differentiate between known and unknown examples. Open set recognition, which addresses this problem, has been studied for approximately a decade. However, conventional open set recognition methods based on deep neural networks (DNNs) lack a foundation for post recognition score analysis. In this paper, we propose a DNN structure in which multiple one-vs-rest sigmoid networks follow a convolutional neural network feature extractor. A one-vs-rest network, which is composed of rectified linear unit activation functions for the hidden layers and a single sigmoid target class output node, can maximize the ability to learn information from nonmatch examples. Furthermore, the network yields a sophisticated nonlinear features-to-output mapping that is explainable in the feature space. By introducing extreme value theory-based calibration techniques, the nonlinear and explainable mapping provides a well-grounded class membership probability models. Our experiments show that one-vs-rest networks can provide more informative hidden representations for unknown examples than the commonly used SoftMax layer. In addition, the proposed probability model outperformed the state-of-the art methods in open set classification scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑