arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.10230cs.CV
收藏

开集识别的One-vs-Rest网络集体决策

Collective Decision of One-vs-Rest Networks for Open Set Recognition

Yonsei University(延世大学)

Jaeyeon Jang, Chang Ouk Kim

摘要:

在训练过程中看不到的未知示例经常出现在现实世界的机器学习任务中,智能自学习系统应该能够区分已知和未知示例。因此,开集识别(OSR),它解决了分类已知和识别未知的问题,最近已经突出。然而,使用softmax层的传统深度神经网络容易受到过度泛化的影响,对未知数产生高置信度。在本文中,我们提出了一个简单的OSR方法的基础上的直觉,OSR性能可以最大限度地通过设置严格和复杂的决策边界,拒绝未知,同时保持令人满意的分类性能的已知。为此,提出了一种新的网络结构,其中多个一对休息网络(OVRN)遵循卷积神经网络特征提取器。在这里,OVRN是一个简单的前馈神经网络,通过学习类特定的判别特征来增强拒绝不匹配的能力。此外,集体决策得分建模结合OVRN达成的多个决定,以减轻过度泛化。在各种数据集上进行了大量的实验,实验结果表明,该方法通过有效地减少过度泛化,性能明显优于现有方法.

英文摘要:

Unknown examples that are unseen during training often appear in real-world machine learning tasks, and an intelligent self-learning system should be able to distinguish between known and unknown examples. Accordingly, open set recognition (OSR), which addresses the problem of classifying knowns and identifying unknowns, has recently been highlighted. However, conventional deep neural networks using a softmax layer are vulnerable to overgeneralization, producing high confidence scores for unknowns. In this paper, we propose a simple OSR method based on the intuition that OSR performance can be maximized by setting strict and sophisticated decision boundaries that reject unknowns while maintaining satisfactory classification performance on knowns. For this purpose, a novel network structure is proposed, in which multiple one-vs-rest networks (OVRNs) follow a convolutional neural network feature extractor. Here, the OVRN is a simple feed-forward neural network that enhances the ability to reject nonmatches by learning class-specific discriminative features. Furthermore, the collective decision score is modeled by combining the multiple decisions reached by the OVRNs to alleviate overgeneralization. Extensive experiments were conducted on various datasets, and the experimental results showed that the proposed method performed significantly better than the state-of-the-art methods by effectively reducing overgeneralization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑