arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.07487cs.CL
收藏

Review-LLM:利用大语言模型实现个性化评论生成

Review-LLM: Harnessing Large Language Models for Personalized Review Generation

School of New Media Communication, Tianjin University(天津大学新媒体与传播学院);Du Xiaoman Financial(度小满金融);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)

Qiyao Peng, Hongtao Liu, Hongyan Xu, Qing Yang, Minglai Shao, Wenjun Wang

AI总结:

针对直接用大语言模型生成评论存在的“礼貌”现象、缺乏个性化的问题,提出Review-LLM方法,通过融合用户历史行为、评分的提示词结合监督微调实现个性化评论生成,性能优于现有闭源LLMs。

摘要:

产品评论生成是推荐系统中的一项重要任务,能够为推荐提供解释性与说服力。近年来,大语言模型(LLMs,例如ChatGPT)展现出了卓越的文本建模与生成能力,可应用于评论生成任务。然而,直接使用LLMs生成评论可能会受限于LLMs的“礼貌”现象,无法生成个性化评论(例如负面评论)。本文提出了为个性化评论生成定制LLMs的Review-LLM方法。首先,我们通过聚合用户历史行为(包含对应商品标题与评论)构建提示词输入,使LLMs能够捕捉用户兴趣特征与评论写作风格。其次,我们将评分作为满意度指标纳入提示词,进一步提升模型对用户偏好的理解,以及对生成评论的情感倾向控制能力。最后,我们将提示文本输入LLMs,并使用监督微调(SFT)使模型为给定用户和目标商品生成个性化评论。在真实世界数据集上的实验结果表明,我们的微调模型比现有闭源LLMs具备更优的评论生成性能。

英文摘要:

Product review generation is an important task in recommender systems, which could provide explanation and persuasiveness for the recommendation. Recently, Large Language Models (LLMs, e.g., ChatGPT) have shown superior text modeling and generating ability, which could be applied in review generation. However, directly applying the LLMs for generating reviews might be troubled by the ``polite'' phenomenon of the LLMs and could not generate personalized reviews (e.g., negative reviews). In this paper, we propose Review-LLM that customizes LLMs for personalized review generation. Firstly, we construct the prompt input by aggregating user historical behaviors, which include corresponding item titles and reviews. This enables the LLMs to capture user interest features and review writing style. Secondly, we incorporate ratings as indicators of satisfaction into the prompt, which could further improve the model's understanding of user preferences and the sentiment tendency control of generated reviews. Finally, we feed the prompt text into LLMs, and use Supervised Fine-Tuning (SFT) to make the model generate personalized reviews for the given user and target item. Experimental results on the real-world dataset show that our fine-tuned model could achieve better review generation performance than existing close-source LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑