arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.03103cs.CL
收藏

多任务学习增强多标签文本分类中的标签相关反馈

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Beijing University of Posts and Telecommunications(北京邮电大学);Tencent Cloud Xiaowei(腾讯云小微)

Ximing Zhang, Qian-Wen Zhang, Zhao Yan, Ruifang Liu, Yunbo Cao

摘要:

在多标签文本分类(MLTC)中,每个给定的文档都与一组相关的标签相关联。为了捕获标签相关性,以前的分类器链和序列到序列模型将MLTC转换为序列预测任务。然而,它们往往遭受标签顺序依赖性,标签组合过拟合和错误传播问题。为了解决这些问题,我们引入了一种新的多任务学习方法来增强标签相关性反馈。我们首先利用联合嵌入(JE)机制,同时获得文本和标签表示。在MLTC任务中,采用文档-标签交叉注意(CA)机制来生成更具区分力的文档表示。此外,我们还提出了两个辅助标签共现预测任务来增强标签相关性学习:1)成对标签共现预测(PLCP)和2)条件标签共现预测(CLCP)。在AAPD和RCV 1-V2数据集上的实验结果表明,该方法的性能大大优于竞争基线。我们分析了低频标签性能,标签依赖性,标签组合多样性和覆盖速度,以显示我们提出的方法对标签相关性学习的有效性。

英文摘要:

In multi-label text classification (MLTC), each given document is associated with a set of correlated labels. To capture label correlations, previous classifier-chain and sequence-to-sequence models transform MLTC to a sequence prediction task. However, they tend to suffer from label order dependency, label combination over-fitting and error propagation problems. To address these problems, we introduce a novel approach with multi-task learning to enhance label correlation feedback. We first utilize a joint embedding (JE) mechanism to obtain the text and label representation simultaneously. In MLTC task, a document-label cross attention (CA) mechanism is adopted to generate a more discriminative document representation. Furthermore, we propose two auxiliary label co-occurrence prediction tasks to enhance label correlation learning: 1) Pairwise Label Co-occurrence Prediction (PLCP), and 2) Conditional Label Co-occurrence Prediction (CLCP). Experimental results on AAPD and RCV1-V2 datasets show that our method outperforms competitive baselines by a large margin. We analyze low-frequency label performance, label dependency, label combination diversity and coverage speed to show the effectiveness of our proposed method on label correlation learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑