arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.01713cs.CLcs.AI
收藏

中文方面情感四元组预测基准的实证研究

An Empirical Study of Benchmarking Chinese Aspect Sentiment Quad Prediction

DataStory(数说故事);International Digital Economy Academy(国际数字经济学院)

Junxian Zhou, Haiqin Yang, Ye Junpeng, Yuxuan He, Hao Mou

AI总结:

本文构建两个万级样本的中文 ASQP 数据集,并系统评测现有基线与 GPT 系列模型,揭示数据规模、四元组密度及模型性能方面的挑战。

摘要:

方面情感四元组预测(ASQP)是方面级情感分析的一个关键子任务。当前 ASQP 数据集具有规模小、四元组密度低的特点,这阻碍了技术发展。为扩展能力,我们构建了两个从多个在线平台爬取的大型中文 ASQP 数据集。这些数据集具有若干显著特征:与现有 ASQP 数据集相比,规模更大(每个均包含 10,000 多个样本)、方面类别丰富、每句词语更多且密度更高。此外,我们首次评估了 Generative Pre-trained Transformer(GPT)系列模型在 ASQP 上的性能,并展示了潜在问题。使用最先进的 ASQP 基线进行的实验强调,需要探索更多技术以解决 ASQP,同时也表明进一步研究提升 GPT 性能的方法具有重要意义。

英文摘要:

Aspect sentiment quad prediction (ASQP) is a critical subtask of aspect-level sentiment analysis. Current ASQP datasets are characterized by their small size and low quadruple density, which hinders technical development. To expand capacity, we construct two large Chinese ASQP datasets crawled from multiple online platforms. The datasets hold several significant characteristics: larger size (each with 10,000+ samples) and rich aspect categories, more words per sentence, and higher density than existing ASQP datasets. Moreover, we are the first to evaluate the performance of Generative Pre-trained Transformer (GPT) series models on ASQP and exhibit potential issues. The experiments with state-of-the-art ASQP baselines underscore the need to explore additional techniques to address ASQP, as well as the importance of further investigation into methods to improve the performance of GPTs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑