arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.05850cs.IR
收藏

探索微调ChatGPT用于新闻推荐

Exploring Fine-tuning ChatGPT for News Recommendation

Xinyi Li, Yongfeng Zhang, Edward C Malthouse

AI总结:

本研究探索微调ChatGPT用于新闻推荐,通过设计排序和评分两种提示,在MIND数据集上验证了微调可显著提升个性化推荐性能,并有效缓解冷物品问题。

摘要:

新闻推荐系统(RS)在当前数字时代发挥着关键作用,塑造着个人获取和参与信息的方式。受GPT和T5系列等大型语言模型兴起的推动,自然语言处理(NLP)与推荐系统的融合模糊了这些领域之间的界限,使得将推荐系统视为一种语言任务成为一种趋势。ChatGPT以其用户友好的界面和日益增长的 popularity 而闻名,已成为广泛NLP任务的热门选择。虽然先前的研究已探索了ChatGPT在推荐任务上的应用,但本研究开创性地调查了其微调能力,特别是在新闻领域。在本研究中,我们设计了两种不同的提示:一种旨在将新闻推荐系统视为排序任务,另一种则针对评分任务进行定制。我们通过这两种任务的表述来获取直接响应,从而评估ChatGPT在新闻推荐中的表现。更重要的是,我们揭示了微调数据质量在增强ChatGPT个性化推荐能力中的关键作用,并展示了其在解决推荐系统中长期存在的“冷物品”问题方面的潜力。我们的实验使用微软新闻数据集(MIND)进行,结果表明ChatGPT在微调后取得了显著改进,特别是在用户主题兴趣保持一致的情况下,将新闻推荐系统视为排序任务时效果尤为明显。这项研究阐明了微调ChatGPT作为推进新闻推荐系统手段的变革潜力,提供了更有效的新闻消费体验。

英文摘要:

News recommendation systems (RS) play a pivotal role in the current digital age, shaping how individuals access and engage with information. The fusion of natural language processing (NLP) and RS, spurred by the rise of large language models such as the GPT and T5 series, blurs the boundaries between these domains, making a tendency to treat RS as a language task. ChatGPT, renowned for its user-friendly interface and increasing popularity, has become a prominent choice for a wide range of NLP tasks. While previous studies have explored ChatGPT on recommendation tasks, this study breaks new ground by investigating its fine-tuning capability, particularly within the news domain. In this study, we design two distinct prompts: one designed to treat news RS as the ranking task and another tailored for the rating task. We evaluate ChatGPT's performance in news recommendation by eliciting direct responses through the formulation of these two tasks. More importantly, we unravel the pivotal role of fine-tuning data quality in enhancing ChatGPT's personalized recommendation capabilities, and illustrates its potential in addressing the longstanding challenge of the "cold item" problem in RS. Our experiments, conducted using the Microsoft News dataset (MIND), reveal significant improvements achieved by ChatGPT after fine-tuning, especially in scenarios where a user's topic interests remain consistent, treating news RS as a ranking task. This study illuminates the transformative potential of fine-tuning ChatGPT as a means to advance news RS, offering more effective news consumption experiences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑