arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.08042cs.IR
收藏

MM-Locate-News:新闻中的多模态焦点位置估计

MM-Locate-News: Multimodal Focus Location Estimation in News

Golsa Tahmasebzadeh, Eric Müller-Budack, Sherzod Hakimov, Ralph Ewerth

摘要:

随着网络成为最具影响力的信息媒介,新闻消费发生了重大变化。为了分析每天发布的大量新闻并将其置于上下文中,文章的地理焦点是一个重要方面,以便实现基于内容的新闻检索。有一些方法和数据集可以从文本或照片中估计地理位置,但它们通常被视为单独的任务。然而,照片可能缺乏地理线索,文本可能包括多个位置,这使得使用单一模态识别焦点位置具有挑战性。本文介绍了一种新的数据集,称为多模态焦点定位的新闻(MM-Locate-News)。我们在新的基准数据集上评估了最先进的方法,并提出了使用文本和图像内容来预测新闻焦点位置的新模型。实验结果表明,多峰模型优于单峰模型。

英文摘要:

The consumption of news has changed significantly as the Web has become the most influential medium for information. To analyze and contextualize the large amount of news published every day, the geographic focus of an article is an important aspect in order to enable content-based news retrieval. There are methods and datasets for geolocation estimation from text or photos, but they are typically considered as separate tasks. However, the photo might lack geographical cues and text can include multiple locations, making it challenging to recognize the focus location using a single modality. In this paper, a novel dataset called Multimodal Focus Location of News (MM-Locate-News) is introduced. We evaluate state-of-the-art methods on the new benchmark dataset and suggest novel models to predict the focus location of news using both textual and image content. The experimental results show that the multimodal model outperforms unimodal models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑