arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.17876cs.IR
收藏

MIND Your Language: 一个用于跨语言新闻推荐的多语言数据集

MIND Your Language: A Multilingual Dataset for Cross-lingual News Recommendation

Andreea Iana, Goran Glavaš, Heiko Paulheim

AI总结:

针对现有新闻推荐缺乏多语言基准的问题,本文提出基于机器翻译的开放多语言数据集 xMIND,覆盖14种语言,并在零样本和少样本跨语言迁移场景下对多种神经新闻推荐器进行了基准测试,发现现有模型在跨语言迁移中存在显著性能损失。

摘要:

数字新闻平台使用新闻推荐器作为主要工具,以满足读者的个性化信息需求。尽管在线社区的语言日益多样化,许多互联网用户使用多种语言阅读新闻,但大多数新闻推荐仍集中在主要的、资源丰富的语言上,尤其是英语。此外,几乎所有新闻推荐工作都假设新闻消费是单语言的,而越来越多的用户倾向于至少使用两种语言消费信息。因此,现有的新闻推荐研究缺乏公开可用的多语言基准,而这些基准能够促进在多语言环境和低资源语言中有效的新闻推荐器的开发。为了填补这一空白,我们引入了 xMIND,这是一个开放的多语言新闻推荐数据集,通过机器翻译从英文 MIND 数据集衍生而来,涵盖了 14 种语言和地理上多样化的语言,并具有不同规模的数字足迹。使用 xMIND,我们在零样本(ZS-XLT)和少样本(FS-XLT)跨语言迁移场景下,系统地基准测试了几种最先进的基于内容的神经新闻推荐器(NNR),同时考虑了单语言和双语新闻消费模式。我们的研究结果表明:(i)当前的 NNR,即使基于多语言语言模型,在 ZS-XLT 下也会遭受显著的性能损失;(ii)在 FS-XLT 训练中包含目标语言数据的收益有限,特别是与双语新闻消费结合时。因此,我们的研究结果值得在多语言和跨语言新闻推荐领域开展更广泛的研究。xMIND 数据集可在 https://github.com/andreeaiana/xMIND 获取。

英文摘要:

Digital news platforms use news recommenders as the main instrument to cater to the individual information needs of readers. Despite an increasingly language-diverse online community, in which many Internet users consume news in multiple languages, the majority of news recommendation focuses on major, resource-rich languages, and English in particular. Moreover, nearly all news recommendation efforts assume monolingual news consumption, whereas more and more users tend to consume information in at least two languages. Accordingly, the existing body of work on news recommendation suffers from a lack of publicly available multilingual benchmarks that would catalyze development of news recommenders effective in multilingual settings and for low-resource languages. Aiming to fill this gap, we introduce xMIND, an open, multilingual news recommendation dataset derived from the English MIND dataset using machine translation, covering a set of 14 linguistically and geographically diverse languages, with digital footprints of varying sizes. Using xMIND, we systematically benchmark several state-of-the-art content-based neural news recommenders (NNRs) in both zero-shot (ZS-XLT) and few-shot (FS-XLT) cross-lingual transfer scenarios, considering both monolingual and bilingual news consumption patterns. Our findings reveal that (i) current NNRs, even when based on a multilingual language model, suffer from substantial performance losses under ZS-XLT and that (ii) inclusion of target-language data in FS-XLT training has limited benefits, particularly when combined with a bilingual news consumption. Our findings thus warrant a broader research effort in multilingual and cross-lingual news recommendation. The xMIND dataset is available at https://github.com/andreeaiana/xMIND.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑