arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.03181cs.LGstat.ML
收藏

用于标签增强和分布学习的双向损失函数

Bidirectional Loss Function for Label Enhancement and Distribution Learning

Shanghai University(上海大学)

Xinyuan Liu, Jihua Zhu, Qinghai Zheng, Zhongyu Li, Ruixin Liu, Jun Wang

摘要:

标签分布学习(LDL)是一种可解释的通用学习范式,已被应用于许多现实世界的应用。与单标签学习(SLL)和多标签学习(MLL)中的简单逻辑向量不同,LDL为每个实例分配具有描述度的标签。在实践中,LDL存在两个挑战,即如何解决LDL学习过程中的维度间隙问题以及如何从现有逻辑标签中准确恢复标签分布,即,标签增强(LE)。对于大多数现有的LDL和LE算法,输入矩阵的维数远高于输出矩阵的维数这一事实往往被忽略,这通常会导致由于单向投影而导致的维数降低。隐藏在特征空间中的有价值的信息在映射过程中丢失。为此,本研究考虑双向投影函数,可以同时应用于LE和LDL问题。更具体地说,这种新的损失函数不仅考虑了从输入空间到输出空间的投影所产生的映射误差,而且还考虑了从输出空间到输入空间的投影所产生的重建误差。该损失函数旨在潜在地从输出数据重构输入数据。因此,有望获得更准确的结果。最后,在几个真实世界的数据集上进行了实验,以证明所提出的方法的LE和LDL的优越性。

英文摘要:

Label distribution learning (LDL) is an interpretable and general learning paradigm that has been applied in many real-world applications. In contrast to the simple logical vector in single-label learning (SLL) and multi-label learning (MLL), LDL assigns labels with a description degree to each instance. In practice, two challenges exist in LDL, namely, how to address the dimensional gap problem during the learning process of LDL and how to exactly recover label distributions from existing logical labels, i.e., Label Enhancement (LE). For most existing LDL and LE algorithms, the fact that the dimension of the input matrix is much higher than that of the output one is alway ignored and it typically leads to the dimensional reduction owing to the unidirectional projection. The valuable information hidden in the feature space is lost during the mapping process. To this end, this study considers bidirectional projections function which can be applied in LE and LDL problems simultaneously. More specifically, this novel loss function not only considers the mapping errors generated from the projection of the input space into the output one but also accounts for the reconstruction errors generated from the projection of the output space back to the input one. This loss function aims to potentially reconstruct the input data from the output data. Therefore, it is expected to obtain more accurate results. Finally, experiments on several real-world datasets are carried out to demonstrate the superiority of the proposed method for both LE and LDL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑