arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.01431cs.LGcs.CV
收藏

具有概率实例过滤的抗噪深度度量学习

Noise-Resistant Deep Metric Learning with Probabilistic Instance Filtering

Nanyang Technological University(南洋理工大学);Alibaba Group(阿里巴巴集团);Shandong University(山东大学)

Chang Liu, Han Yu, Boyang Li, Zhiqi Shen, Zhanning Gao, Peiran Ren, Xuansong Xie, Lizhen Cui, Chunyan Miao

摘要:

噪声标签是真实世界数据中的常见现象,它会导致深度神经网络的性能下降。手动清理数据是劳动密集型和耗时的。以前的研究主要集中在针对噪声标签增强分类模型,而深度度量学习(DML)对噪声标签的鲁棒性仍然没有得到很好的探索。在本文中,我们提出了基于概率排序的实例选择与内存(PRISM)方法的DML弥合这一重要差距。PRISM计算标签干净的概率,并过滤掉潜在的噪声样本。具体而言,我们提出了一种新的方法,即冯米塞斯-费舍尔分布相似性(vMF-Sim),通过估计每个数据类的冯米塞斯-费舍尔(vMF)分布来计算这种概率。与现有的平均相似度方法(AvgSim)相比,vMF-Sim在考虑平均相似度的基础上,还考虑了每个类的方差。通过这样的设计,所提出的方法可以处理具有挑战性的DML情况下,其中大多数的样本是嘈杂的。在合成和真实世界的噪声数据集上进行的大量实验表明,与最佳性能的最先进的基线方法相比,所提出的方法在合理的训练时间内实现了高达8.37%的精度@1。

英文摘要:

Noisy labels are commonly found in real-world data, which cause performance degradation of deep neural networks. Cleaning data manually is labour-intensive and time-consuming. Previous research mostly focuses on enhancing classification models against noisy labels, while the robustness of deep metric learning (DML) against noisy labels remains less well-explored. In this paper, we bridge this important gap by proposing Probabilistic Ranking-based Instance Selection with Memory (PRISM) approach for DML. PRISM calculates the probability of a label being clean, and filters out potentially noisy samples. Specifically, we propose a novel method, namely the von Mises-Fisher Distribution Similarity (vMF-Sim), to calculate this probability by estimating a von Mises-Fisher (vMF) distribution for each data class. Compared with the existing average similarity method (AvgSim), vMF-Sim considers the variance of each class in addition to the average similarity. With such a design, the proposed approach can deal with challenging DML situations in which the majority of the samples are noisy. Extensive experiments on both synthetic and real-world noisy dataset show that the proposed approach achieves up to 8.37% higher Precision@1 compared with the best performing state-of-the-art baseline approaches, within reasonable training time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑