arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.14997cs.CL
收藏

利用大语言模型和位置信息增强旅游领域的基于方面的情感分析

Enhancing Aspect-based Sentiment Analysis in Tourism Using Large Language Models and Positional Information

Xinjiang University of Finance and Economics(新疆财经大学);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)

Chun Xu, Mengmeng Wang, Yan Ren, Shaolin Zhu

AI总结:

针对旅游领域ABSA传统流水线模型的错误传播和提取不全问题,提出ACOS_LLM模型,结合大模型微调压缩与位置信息进行四元组提取,在多个数据集上取得显著F1提升。

摘要:

旅游领域的基于方面的情感分析(ABSA)在理解游客对景点特定方面的评价中发挥重要作用,这对推动旅游业创新发展至关重要。然而,传统的流水线模型受到错误传播和情感元素提取不完整等问题的困扰。为缓解此问题,本文提出了一种基于方面的情感分析模型ACOS_LLM,用于方面-类别-观点-情感四元组提取(ACOSQE)。该模型包含两个关键阶段:辅助知识生成和ACOSQE。首先,使用Adalora微调大语言模型以生成高质量的辅助知识。为提升模型效率,利用Sparsegpt将微调后的模型压缩至50%的稀疏度。随后,采用位置信息和序列建模来完成ACOSQE任务,以辅助知识和原文作为输入。实验在自建旅游数据集及公开数据集Rest15和Rest16上进行。结果表明该模型性能优越,在旅游数据集上F1值较其他模型提升了7.49%。此外,在Rest15和Rest16数据集上F1值分别提升了0.05%和1.06%。

英文摘要:

Aspect-Based Sentiment Analysis (ABSA) in tourism plays a significant role in understanding tourists' evaluations of specific aspects of attractions, which is crucial for driving innovation and development in the tourism industry. However, traditional pipeline models are afflicted by issues such as error propagation and incomplete extraction of sentiment elements. To alleviate this issue, this paper proposes an aspect-based sentiment analysis model, ACOS_LLM, for Aspect-Category-Opinion-Sentiment Quadruple Extraction (ACOSQE). The model comprises two key stages: auxiliary knowledge generation and ACOSQE. Firstly, Adalora is used to fine-tune large language models for generating high-quality auxiliary knowledge. To enhance model efficiency, Sparsegpt is utilized to compress the fine-tuned model to 50% sparsity. Subsequently, Positional information and sequence modeling are employed to achieve the ACOSQE task, with auxiliary knowledge and the original text as inputs. Experiments are conducted on both self-created tourism datasets and publicly available datasets, Rest15 and Rest16. Results demonstrate the model's superior performance, with an F1 improvement of 7.49% compared to other models on the tourism dataset. Additionally, there is an F1 improvement of 0.05% and 1.06% on the Rest15 and Rest16 datasets, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑