arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.07413cs.IR
收藏

基于预训练语言模型的新闻推荐

Empowering News Recommendation with Pre-trained Language Models

Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang

摘要:

个性化新闻推荐是在线新闻服务的一项重要技术。新闻文章通常包含丰富的文本内容,准确的新闻建模对于个性化新闻推荐非常重要。现有的新闻推荐方法主要基于传统的文本建模方法对新闻文本进行建模,这对于挖掘新闻文本中的深层语义信息并不是最优的。预训练的语言模型(PLM)对于自然语言理解是强大的,这具有更好的新闻建模的潜力。然而,目前还没有公开的报道表明PLM已经应用于新闻推荐。在本文中,我们报告了我们的工作,利用预先训练的语言模型,使新闻推荐。在单语言和多语言新闻推荐数据集上的离线实验结果表明,利用PLM进行新闻建模可以有效地提高新闻推荐的性能。我们基于PLM的新闻推荐模型已部署到Microsoft News平台,并在英语和全球市场的点击量和页面浏览量方面取得了显著增长。

英文摘要:

Personalized news recommendation is an essential technique for online news services. News articles usually contain rich textual content, and accurate news modeling is important for personalized news recommendation. Existing news recommendation methods mainly model news texts based on traditional text modeling methods, which is not optimal for mining the deep semantic information in news texts. Pre-trained language models (PLMs) are powerful for natural language understanding, which has the potential for better news modeling. However, there is no public report that show PLMs have been applied to news recommendation. In this paper, we report our work on exploiting pre-trained language models to empower news recommendation. Offline experimental results on both monolingual and multilingual news recommendation datasets show that leveraging PLMs for news modeling can effectively improve the performance of news recommendation. Our PLM-empowered news recommendation models have been deployed to the Microsoft News platform, and achieved significant gains in terms of both click and pageview in both English-speaking and global markets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑