CreAgent:平台-创作者信息不对称下推荐系统的长期评估研究
CreAgent: Towards Long-Term Evaluation of Recommender System under Platform-Creator Information Asymmetry
AI总结:
针对推荐系统长期评估忽视创作者信息不对称的问题,提出基于LLM的CreAgent模拟智能体,融合博弈论与快慢思考框架并经PPO微调,提升评估可靠性,可探索公平多样性算法的长期效益。
摘要:
确保推荐系统(RS)的长期可持续性成为关键问题。传统RS离线评估方法通常聚焦点击等即时用户反馈,却常忽视内容创作者的长期影响。在真实内容平台上,创作者会基于用户反馈和偏好趋势策略性地生产与上传新内容。尽管以往研究尝试建模创作者行为,但常忽略信息不对称的作用:创作者主要获取自身内容的反馈,而平台掌握全量用户反馈数据。当前RS模拟器未考虑这种不对称,导致长期评估不准确。为此,我们提出基于大语言模型(LLM)的创作者模拟智能体CreAgent,融合博弈论信念机制与快慢思考框架,有效模拟信息不对称下的创作者行为;还通过近端策略优化(PPO)微调增强其模拟能力。可信度验证实验显示,CreAgent与真实平台-创作者行为高度契合,提升了长期RS评估的可靠性;通过CreAgent模拟RS,可探索公平性与多样性感知RS算法如何为各利益相关方带来更好的长期性能。CreAgent及模拟平台已开源:https://github.com/shawnye2000/CreAgent。
英文摘要:
Ensuring the long-term sustainability of recommender systems (RS) emerges as a crucial issue. Traditional offline evaluation methods for RS typically focus on immediate user feedback, such as clicks, but they often neglect the long-term impact of content creators. On real-world content platforms, creators can strategically produce and upload new items based on user feedback and preference trends. While previous studies have attempted to model creator behavior, they often overlook the role of information asymmetry. This asymmetry arises because creators primarily have access to feedback on the items they produce, while platforms possess data on the entire spectrum of user feedback. Current RS simulators, however, fail to account for this asymmetry, leading to inaccurate long-term evaluations. To address this gap, we propose CreAgent, a Large Language Model (LLM)-empowered creator simulation agent. By incorporating game theory's belief mechanism and the fast-and-slow thinking framework, CreAgent effectively simulates creator behavior under conditions of information asymmetry. Additionally, we enhance CreAgent's simulation ability by fine-tuning it using Proximal Policy Optimization (PPO). Our credibility validation experiments show that CreAgent aligns well with the behaviors between real-world platform and creator, thus improving the reliability of long-term RS evaluations. Moreover, through the simulation of RS involving CreAgents, we can explore how fairness- and diversity-aware RS algorithms contribute to better long-term performance for various stakeholders. CreAgent and the simulation platform are publicly available at https://github.com/shawnye2000/CreAgent.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。