arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.06809cs.IR
收藏

将对话式推荐系统重构为三阶段离线策略学习

Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning

Gangyi Zhang, Chongming Gao, Hang Pan, Runzhe Teng, Ruizhe Li

AI总结:

针对CRS依赖用户模拟器导致模拟有效而部署失效的问题,本文提出TCRS,融合基于模型的离线学习与可控用户模拟,以降低实时交互依赖并提升推荐鲁棒性、适应性与准确性。

摘要:

现有的对话式推荐系统(CRS)主要利用用户模拟器来训练和评估推荐策略。这些模拟器往往只关注静态物品属性,过度简化了用户交互的复杂性,忽视了真实世界用户行为所特有的丰富且不断演变的偏好。这一局限常常导致模型在模拟环境中表现良好,却在实际部署时失效。为应对这些挑战,本文提出了基于三阶段离线策略学习的对话式推荐系统(TCRS),显著降低了对实时交互的依赖,并缓解了传统方法中普遍存在的过拟合问题。TCRS将基于模型的离线学习策略与可控用户模拟相结合,能够动态适应用户的个性化偏好及不断演变的偏好。通过全面实验,TCRS在推荐的鲁棒性、适应性和准确性方面均表现出提升,并在多样化用户场景中优于传统CRS模型。该方法不仅提供了更贴近现实的评估环境,还有助于更深入地理解用户行为动态,从而优化推荐过程。

英文摘要:

Existing Conversational Recommender Systems (CRS) predominantly utilize user simulators for training and evaluating recommendation policies. These simulators often oversimplify the complexity of user interactions by focusing solely on static item attributes, neglecting the rich, evolving preferences that characterize real-world user behavior. This limitation frequently leads to models that perform well in simulated environments but falter in actual deployment. Addressing these challenges, this paper introduces the Tri-Phase Offline Policy Learning-based Conversational Recommender System (TCRS), which significantly reduces dependency on real-time interactions and mitigates overfitting issues prevalent in traditional approaches. TCRS integrates a model-based offline learning strategy with a controllable user simulation that dynamically aligns with both personalized and evolving user preferences. Through comprehensive experiments, TCRS demonstrates enhanced robustness, adaptability, and accuracy in recommendations, outperforming traditional CRS models in diverse user scenarios. This approach not only provides a more realistic evaluation environment but also facilitates a deeper understanding of user behavior dynamics, thereby refining the recommendation process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑