arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.09500cs.LG
收藏

从互补标签学习到概率估计的归约

Reduction from Complementary-Label Learning to Probability Estimates

National Taiwan University(台湾大学)

Wei-I Lin, Hsuan-Tien Lin

AI总结:

本文提出将互补标签学习归约到互补类别的概率估计的新框架,证明准确概率估计可通过简单解码得到良好分类器,并设计了更鲁棒的算法和验证方法。

摘要:

互补标签学习(Complementary-Label Learning, CLL)是一种弱监督学习问题,旨在仅从互补标签中学习多类分类器,互补标签指示某个实例不属于的类别。现有方法主要采用归约到普通分类的范式,即应用特定的变换和替代损失将CLL与普通分类联系起来。然而,这些方法面临若干局限,例如容易过拟合或过度依赖深度模型。在本文中,我们以一种新颖的视角绕开这些局限——归约到互补类别的概率估计。我们证明,准确的互补标签概率估计通过一个简单的解码步骤即可得到良好的分类器。该证明建立了一个从CLL到概率估计的归约框架。该框架将若干关键的CLL方法解释为其特例,并使我们能够设计出一种在噪声环境中更鲁棒的改进算法。该框架还提出了一种基于概率估计质量的验证程序,为仅使用互补标签验证模型提供了一种替代方法。这一灵活的框架为使用深度和非深度模型进行概率估计以解决CLL问题开辟了广泛的尚未探索的机会。实证实验进一步验证了该框架在各种设置下的有效性和鲁棒性。

英文摘要:

Complementary-Label Learning (CLL) is a weakly-supervised learning problem that aims to learn a multi-class classifier from only complementary labels, which indicate a class to which an instance does not belong. Existing approaches mainly adopt the paradigm of reduction to ordinary classification, which applies specific transformations and surrogate losses to connect CLL back to ordinary classification. Those approaches, however, face several limitations, such as the tendency to overfit or be hooked on deep models. In this paper, we sidestep those limitations with a novel perspective--reduction to probability estimates of complementary classes. We prove that accurate probability estimates of complementary labels lead to good classifiers through a simple decoding step. The proof establishes a reduction framework from CLL to probability estimates. The framework offers explanations of several key CLL approaches as its special cases and allows us to design an improved algorithm that is more robust in noisy environments. The framework also suggests a validation procedure based on the quality of probability estimates, leading to an alternative way to validate models with only complementary labels. The flexible framework opens a wide range of unexplored opportunities in using deep and non-deep models for probability estimates to solve the CLL problem. Empirical experiments further verified the framework's efficacy and robustness in various settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑