arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.00341cs.CL
收藏

基于大语言模型的迭代式数据生成用于方面级情感分析

Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis

Wuhan University(武汉大学)

Qihuang Zhong, Haiyun Li, Luyao Zhuang, Juhua Liu, Bo Du

AI总结:

本文提出迭代式数据生成框架IDG,利用大语言模型的指令遵循、上下文学习和自我反思能力,从无监督语料生成多样流畅的ABSA伪标签数据,在多个基准上取得显著提升。

摘要:

方面级情感分析(ABSA)是一项重要的情感分析任务,旨在判断句子中针对某个方面的情感极性。由于标注数据昂贵且有限,数据生成(DG)已成为提升ABSA性能的标准手段。然而,当前的DG方法通常存在一些不足:1)流畅性和连贯性较差;2)生成数据缺乏多样性;3)依赖一些已有的标注数据,这阻碍了其在真实场景中的应用。随着大语言模型(LLMs)的发展,基于LLM的DG有潜力解决上述问题。遗憾的是,直接提示LLMs难以生成所需的伪标签ABSA数据,因为LLMs容易产生幻觉,从而导致不期望的数据生成。为此,我们提出了一个系统化的迭代式数据生成框架,即IDG,以提升ABSA的性能。IDG的核心是充分利用LLMs的强大能力(即指令遵循、上下文学习和自我反思),从无监督句子语料库出发,迭代地生成更流畅、更多样的伪标签数据。具体而言,IDG设计了一种新颖的迭代式数据生成机制和一个自我反思数据过滤模块,以应对由幻觉引起的意外数据生成挑战。在四个广泛使用的ABSA基准上的大量实验表明,IDG在五个基线ABSA模型上带来了一致且显著的性能提升。更令人鼓舞的是,IDG生成的合成数据可以达到与人工标注数据相当甚至更好的性能。

英文摘要:

Aspect-based Sentiment Analysis (ABSA) is an important sentiment analysis task, which aims to determine the sentiment polarity towards an aspect in a sentence. Due to the expensive and limited labeled data, data generation (DG) has become the standard for improving the performance of ABSA. However, current DG methods usually have some shortcomings: 1) poor fluency and coherence, 2) lack of diversity of generated data, and 3) reliance on some existing labeled data, hindering its applications in real-world scenarios. With the advancement of large language models (LLMs), LLM-based DG has the potential to solve the above issues. Unfortunately, directly prompting LLMs struggles to generate the desired pseudo-label ABSA data, as LLMs are prone to hallucinations, leading to undesired data generation. To this end, we propose a systematic Iterative Data Generation framework, namely IDG, to boost the performance of ABSA. The core of IDG is to make full use of the powerful abilities (i.e., instruction-following, in-context learning and self-reflection) of LLMs to iteratively generate more fluent and diverse pseudo-label data, starting from an unsupervised sentence corpus. Specifically, IDG designs a novel iterative data generation mechanism and a self-reflection data filtering module to tackle the challenges of unexpected data generation caused by hallucinations. Extensive experiments on four widely-used ABSA benchmarks show that IDG brings consistent and significant performance gains among five baseline ABSA models. More encouragingly, the synthetic data generated by IDG can achieve comparable or even better performance against the manually annotated data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑