The significance of estimating video watch time has been highlighted by the rising importance of (short) video recommendation, which has become a core product of mainstream social media platforms. Modeling video watch time, however, has been challenged by the complexity of user-video interaction, such as different user behavior modes in watching the recommended videos and varying watching probability over the video progress bar. Despite the importance and challenges, existing literature on modeling video watch time mostly focuses on relatively black-box mechanical enhancement of the classical regression/classification losses, without factoring in user behavior in a principled manner. In this paper, we for the first time take on a user-centric perspective to model video watch time, from which we propose a white-box statistical framework that directly translates various user behavior assumptions in watching (short) videos into statistical watch time models. These behavior assumptions are portrayed by our domain knowledge on users' behavior modes in video watching. We further employ bucketization to cope with user's non-stationary watching probability over the video progress bar, which additionally helps to respect the constraint of video length and facilitate the practical compatibility between the continuous regression event of watch time and other binary classification events. We test our models extensively on two public datasets, a large-scale offline industrial dataset, and an online A/B test on a short video platform with hundreds of millions of daily-active users. On all experiments, our models perform competitively against strong relevant baselines, demonstrating the efficacy of our user-centric perspective and proposed framework.
DVR: Micro-Video Recommendation Optimizing Watch-Time-Gain under Duration Bias
推荐系统很容易被数据中的偏见所误导。使用有偏数据训练的模型无法捕捉用户的真实兴趣,因此减轻偏置的影响以实现无偏推荐至关重要。在这项工作中,我们专注于微视频推荐中的一个重要偏见,持续时间偏见。具体而言,现有的微视频推荐系统通常将观看时间视为最关键的度量,其测量用户观看视频的时间。由于时长较长的视频往往具有较长的观看时间,因此存在一种时长偏差,使得较长的视频往往比短视频更受推荐。在本文中,我们的经验表明,常用的指标是脆弱的持续时间偏差,使他们不适合评估微视频推荐。为了解决这个问题,我们进一步提出了一个无偏的评估指标,称为WTG(简称观看时间增益)。实验结果表明,WTG可以减轻持续时间偏差,更好地衡量推荐性能。此外,我们设计了一个简单而有效的模型DVR(Debiased Video Recommendation的缩写),可以提供不同时长的微视频的无偏推荐,并通过对抗学习来学习无偏的用户偏好。基于两个真实数据集的大量实验表明,DVR成功地消除了持续时间偏差,并显着提高推荐性能超过30%的相对进步。代码和数据集在https://github.com/tsinghua-fib-lab/WTG-DVR上发布。