arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.12152cs.HC
收藏

用LLM将推荐解释情境化:一项用户研究

Contextualizing Recommendation Explanations with LLMs: A User Study

Yuanjun Feng, Stefan Feuerriegel, Yash Raj Shrestha

AI总结:

本文通过在线实验和访谈研究LLM生成的电影推荐解释,发现融入用户过去行为的情境化解释能有效满足认知需求并提高观看意图,但对实用和情感需求收益有限,为以用户为中心的推荐系统设计提供启示。

摘要:

大型语言模型(LLMs)在推荐系统中日益普及,LLMs可用于生成个性化推荐。本文考察了不同LLM生成的电影推荐解释如何影响用户对认知需求、情感需求和实用需求的感知以及消费意图。在一项预先注册的受试者间在线实验(N=759)和后续访谈(N=30)中,我们比较了(a)LLM生成的通用解释和(b)LLM生成的情境化解释。研究结果表明,情境化解释(即融入用户过去行为的解释)能有效满足用户的认知需求,同时提高用户观看推荐电影的意图。然而,添加解释在满足用户实用需求和情感需求方面收益有限,这引发了对LLM生成解释的合理设计及其影响的担忧。访谈中的定性见解揭示,引用用户过去的偏好能增强信任和理解,但如果过度使用可能会让人感到多余。此外,与推荐系统和电影观看互动更积极、更正向的用户能从情境化解释中获得显著收益。总体而言,本研究阐明了LLM生成的推荐如何影响用户的动机和行为,为未来以用户为中心的推荐系统发展提供了有价值的见解,而推荐系统是社交媒体平台和在线生态系统中的关键要素。

英文摘要:

Large language models (LLMs) are increasingly prevalent in recommender systems, where LLMs can be used to generate personalized recommendations. Here, we examine how different LLM-generated explanations for movie recommendations affect users' perceptions of cognitive, affective, and utilitarian needs and consumption intentions. In a pre-registered, between-subject online experiment (N=759) and follow-up interviews (N=30), we compare (a) LLM-generated generic explanations, and (b) LLM-generated contextualized explanations. Our findings show that contextualized explanations (i.e., explanations that incorporate users' past behaviors) effectively meet users' cognitive needs while increasing users' intentions to watch recommended movies. However, adding explanations offers limited benefits in meeting users' utilitarian and affective needs, raising concerns about the proper design and implications of LLM-generated explanations. Qualitative insights from interviews reveal that referencing users' past preferences enhances trust and understanding but can feel excessive if overused. Furthermore, users with more active and positive engagement with the recommender system and movie-watching get substantial gains from contextualized explanations. Overall, our research clarifies how LLM-generated recommendations influence users' motivations and behaviors, providing valuable insights for the future development of user-centric recommender systems, a key element in social media platforms and online ecosystems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑