arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.18078cs.CLcs.AI
收藏

基于伪标签评分器的自训练用于方面情感四元组预测

Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction

Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室)

Yice Zhang, Jie Zeng, Weiming Hu, Ziyi Wang, Shiwei Chen, Ruifeng Xu

AI总结:

针对ASQP任务标注数据稀缺问题,提出带伪标签评分器的自训练框架,通过过滤不匹配伪标签提升性能,实验证明有效且可用大语言模型替代人工标注。

摘要:

方面情感四元组预测(ASQP)旨在预测给定评论中的所有四元组(方面词、方面类别、观点词、情感极性),这是基于方面的情感分析中最具代表性和挑战性的任务。ASQP任务中的一个关键挑战是标注数据的稀缺性,这限制了现有方法的性能。为解决此问题,我们提出了一种带有伪标签评分器的自训练框架,其中评分器评估评论与其伪标签之间的匹配程度,旨在过滤不匹配项,从而增强自训练的有效性。我们强调两个关键方面以确保评分器的有效性和可靠性:训练数据集的质量及其模型架构。为此,我们构建了一个人工标注的比较数据集,并使用基于排序的目标在该数据集上训练一个生成模型。在公开的ASQP数据集上进行的大量实验表明,使用我们的评分器可以大幅且一致地提升自训练的有效性。此外,我们探索了用大型语言模型替代人类进行比较数据集标注的可能性,实验证明了其可行性。我们在https://github.com/HITSZ-HLT/ST-w-Scorer-ABSA 发布了我们的代码和数据。

英文摘要:

Aspect Sentiment Quad Prediction (ASQP) aims to predict all quads (aspect term, aspect category, opinion term, sentiment polarity) for a given review, which is the most representative and challenging task in aspect-based sentiment analysis. A key challenge in the ASQP task is the scarcity of labeled data, which limits the performance of existing methods. To tackle this issue, we propose a self-training framework with a pseudo-label scorer, wherein a scorer assesses the match between reviews and their pseudo-labels, aiming to filter out mismatches and thereby enhance the effectiveness of self-training. We highlight two critical aspects to ensure the scorer's effectiveness and reliability: the quality of the training dataset and its model architecture. To this end, we create a human-annotated comparison dataset and train a generative model on it using ranking-based objectives. Extensive experiments on public ASQP datasets reveal that using our scorer can greatly and consistently improve the effectiveness of self-training. Moreover, we explore the possibility of replacing humans with large language models for comparison dataset annotation, and experiments demonstrate its feasibility. We release our code and data at https://github.com/HITSZ-HLT/ST-w-Scorer-ABSA .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑