arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.09929cs.SI
收藏

一种通过跟踪Web上的图像和分析其过去上下文来检测误导图像的统一方法

A Unified Approach of Detecting Misleading Images via Tracing its Instances on Web and Analysing its Past Context for the Verification of Content

Deepika Varshney, Dinesh Kumar Vishwakarma

摘要:

社交媒体上的多媒体内容的验证是当前情况下具有挑战性和关键性的问题之一,并且在用户生成的内容和在线社交网络平台是塑造和传播新闻故事的主要来源的时代越来越突出。由于这些来源允许用户不受限制地分享他们的观点,机会主义用户经常在Twitter,Facebook等社交媒体上发布误导/不可靠的内容。保留这些内容对保持社交媒体信息的可信度和可靠性至关重要。出于这一动机,我们提出了一个广义的系统,支持自动分类的图像到可信或误导。在本文中,我们研究了基于机器学习以及基于深度学习的方法,用于验证误导性多媒体内容,其中可用的图像痕迹用于识别内容的可信度。该实验是在从Twitter收集的真实世界数据集(中世纪-2015数据集)上进行的。它还使用机器和深度学习模型(双向LSTM)展示了我们提出的方法和功能的效率。实验结果表明,微软的bings图像搜索引擎是相当有效的检索标题,表现优于我们研究的谷歌图像搜索引擎。它还表明,从附加的多媒体内容(图像)中收集线索比仅检测发布的基于内容的特征更有效。

英文摘要:

The verification of multimedia content over social media is one of the challenging and crucial issues in the current scenario and gaining prominence in an age where user-generated content and online social web platforms are the leading sources in shaping and propagating news stories. As these sources allow users to share their opinions without restriction, opportunistic users often post misleading/ unreliable content on social media such as Twitter, Facebook, etc. At present, to lure users towards the news story, the text is often attached with some multimedia content (images/videos/audios). Verifying these contents to maintain the credibility and reliability of social media information is of paramount importance. Motivated by this, we proposed a generalized system that supports the automatic classification of images into credible or misleading. In this paper, we investigated machine learning-based as well as deep learning-based approaches utilized to verify misleading multimedia content, where the available image traces are used to identify the credibility of the content. The experiment is performed on the real-world dataset (Media-eval-2015 dataset) collected from Twitter. It also demonstrates the efficiency of our proposed approach and features using both Machine and Deep Learning Model (Bi-directional LSTM). The experiment result reveals that the Microsoft bings image search engine is quite effective in retrieving titles and performs better than our study's Google image search engine. It also shows that gathering clues from attached multimedia content (image) is more effective than detecting only posted content-based features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑