arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.02702cs.CLcs.AI
收藏

从客户评论中提取非典型方面:数据集与语言模型实验

Extraction of Atypical Aspects from Customer Reviews: Datasets and Experiments with Language Models

University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校)

Smita Nannaware, Erfan Al-Hossami, Razvan Bunescu

AI总结:

本文提出客户评论非典型方面检测任务,构建餐厅、酒店、美发沙龙三领域标注基准数据集,评估Flan-T5微调及GPT-3.5零/少样本提示等语言模型的效果。

摘要:

一顿餐厅晚餐可能因客户喜爱的某个意外方面成为难忘体验,比如等候区的折纸手工台。如果能提前知晓餐厅体验中的非典型方面,就可利用它们生成有望带来惊喜体验的推荐,进一步提升用户满意度。这类非典型方面虽相对罕见,但一旦遇到,因其令人难忘的特性往往会被写进评论中。据此,本文提出了客户评论中非典型方面检测任务。为助力提取模型的开发,我们手动标注了餐厅、酒店和美发沙龙三个领域的评论基准数据集,并使用这些数据集评估了多种语言模型,涵盖对基于指令的文本到文本Transformer模型Flan-T5进行微调,以及对GPT-3.5进行零样本和少样本提示的方案。

英文摘要:

A restaurant dinner may become a memorable experience due to an unexpected aspect enjoyed by the customer, such as an origami-making station in the waiting area. If aspects that are atypical for a restaurant experience were known in advance, they could be leveraged to make recommendations that have the potential to engender serendipitous experiences, further increasing user satisfaction. Although relatively rare, whenever encountered, atypical aspects often end up being mentioned in reviews due to their memorable quality. Correspondingly, in this paper we introduce the task of detecting atypical aspects in customer reviews. To facilitate the development of extraction models, we manually annotate benchmark datasets of reviews in three domains - restaurants, hotels, and hair salons, which we use to evaluate a number of language models, ranging from fine-tuning the instruction-based text-to-text transformer Flan-T5 to zero-shot and few-shot prompting of GPT-3.5.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑