arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1808.06664stat.MLcs.LG
收藏

使用多个语义标签表示的分布外检测

Out-of-Distribution Detection using Multiple Semantic Label Representations

Bar-Ilan University(巴伊兰大学)

Gabi Shalev, Yossi Adi, Joseph Keshet

摘要:

深度神经网络是强大的模型,在各种任务上都取得了显著的成果。当训练和测试数据来自同一分布时,这些模型被证明是非常有效的。然而,目前尚不清楚当网络被提供了一个分布外的例子时,它将如何行动。本文研究了神经网络中的分布外检测问题。我们建议使用多个语义密集表示而不是稀疏表示作为目标标签。具体来说,我们建议使用从不同的语料库或架构中获得的几个单词表示作为目标标签。我们评估了所提出的模型对计算机视觉和语音命令检测任务,并将其与以前的方法进行了比较。结果表明,我们的方法与以前的工作相比,毫不逊色。此外,我们提出了我们的方法检测错误分类和对抗性的例子的效率。

英文摘要:

Deep Neural Networks are powerful models that attained remarkable results on a variety of tasks. These models are shown to be extremely efficient when training and test data are drawn from the same distribution. However, it is not clear how a network will act when it is fed with an out-of-distribution example. In this work, we consider the problem of out-of-distribution detection in neural networks. We propose to use multiple semantic dense representations instead of sparse representation as the target label. Specifically, we propose to use several word representations obtained from different corpora or architectures as target labels. We evaluated the proposed model on computer vision, and speech commands detection tasks and compared it to previous methods. Results suggest that our method compares favorably with previous work. Besides, we present the efficiency of our approach for detecting wrongly classified and adversarial examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑