arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.01170cs.LG
收藏

通过学习多标签表示实现带偏标注的标签分布学习

Label Distribution Learning with Biased Annotations by Learning Multi-Label Representation

Southeast University(东南大学);Center for Advanced Intelligence Project, RIKEN(理化学研究所高级智能项目中心);The University of Tokyo(东京大学);The University of Sydney(悉尼大学);Xi'an Jiaotong University(西安交通大学)

Zhiqiang Kou, Si Qin, Hailin Wang, Mingkun Xie, Shuo Chen, Yuheng Jia, Tongliang Liu, Masashi Sugiyama, Xin Geng

AI总结:

本文针对带偏标注的标签分布学习问题,提出先将软标签分布退化为硬多热标签再恢复真实标签信息的新方法,利用多标签空间的低秩假设更合理地捕捉标签相关性,并通过理论和实验验证了其有效性与鲁棒性。

摘要:

多标签学习(MLL)因其表示真实世界数据的能力而受到关注。标签分布学习(LDL)作为MLL向从标签分布中学习的扩展,在收集准确的标签分布方面面临挑战。为了解决带偏标注的问题,现有工作基于低秩假设,通过探索标签相关性从带偏观测中恢复真实分布。然而,近期证据表明标签分布往往趋于满秩,对带偏观测直接应用低秩近似会导致恢复不准确和性能下降。本文从一个新的视角处理带偏标注的LDL问题:我们首先将软标签分布退化为硬多热标签,然后为每个实例恢复真实标签信息。这一思想源于一个见解:分配硬多热标签通常比分配软标签分布更容易,并且它对噪声扰动表现出更强的免疫力,从而产生更小的标签偏差。此外,假设用于预测标签分布的多标签空间是低秩的,为捕捉标签相关性提供了一种更合理的方法。理论分析和实验证实了我们的方法在真实世界数据集上的有效性和鲁棒性。

英文摘要:

Multi-label learning (MLL) has gained attention for its ability to represent real-world data. Label Distribution Learning (LDL), an extension of MLL to learning from label distributions, faces challenges in collecting accurate label distributions. To address the issue of biased annotations, based on the low-rank assumption, existing works recover true distributions from biased observations by exploring the label correlations. However, recent evidence shows that the label distribution tends to be full-rank, and naive apply of low-rank approximation on biased observation leads to inaccurate recovery and performance degradation. In this paper, we address the LDL with biased annotations problem from a novel perspective, where we first degenerate the soft label distribution into a hard multi-hot label and then recover the true label information for each instance. This idea stems from an insight that assigning hard multi-hot labels is often easier than assigning a soft label distribution, and it shows stronger immunity to noise disturbances, leading to smaller label bias. Moreover, assuming that the multi-label space for predicting label distributions is low-rank offers a more reasonable approach to capturing label correlations. Theoretical analysis and experiments confirm the effectiveness and robustness of our method on real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑