arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.17008cs.LG
收藏

基于熵权的协同标签校正

Collaborative Label Correction via Entropy Thresholding

Cooperative Medianet Innovation Center Shanghai Jiao Tong University(上海交通大学协同媒体创新中心)

Hao Wu, Jiangchao Yao, Jiajie Wang, Yinru Chen, Ya Zhang, Yanfeng Wang

摘要:

深度神经网络(DNN)有能力适应非常嘈杂的标签,尽管如此,它们倾向于首先学习带有干净标签的数据,然后记住带有嘈杂标签的数据。我们研究这种行为的预测的香农熵的光,并证明由给定的阈值确定的低熵预测是更可靠的监督比原来的嘈杂的标签。它还显示了比以前的方法保持更多训练样本的优势。然后,我们使用协作标签校正(CLC)框架来支持这个熵标准,以进一步避免单个网络的不期望的局部最小值。一系列的实验已经进行了多个基准与合成和现实世界的设置。广泛的结果表明,我们的CLC优于几个国家的最先进的方法。

英文摘要:

Deep neural networks (DNNs) have the capacity to fit extremely noisy labels nonetheless they tend to learn data with clean labels first and then memorize those with noisy labels. We examine this behavior in light of the Shannon entropy of the predictions and demonstrate the low entropy predictions determined by a given threshold are much more reliable as the supervision than the original noisy labels. It also shows the advantage in maintaining more training samples than previous methods. Then, we power this entropy criterion with the Collaborative Label Correction (CLC) framework to further avoid undesired local minimums of the single network. A range of experiments have been conducted on multiple benchmarks with both synthetic and real-world settings. Extensive results indicate that our CLC outperforms several state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑