Fake news detection plays a crucial role in protecting social media users and maintaining a healthy news ecosystem. Among existing works, comment-based fake news detection methods are empirically shown as promising because comments could reflect users' opinions, stances, and emotions and deepen models' understanding of fake news. Unfortunately, due to exposure bias and users' different willingness to comment, it is not easy to obtain diverse comments in reality, especially for early detection scenarios. Without obtaining the comments from the ``silent'' users, the perceived opinions may be incomplete, subsequently affecting news veracity judgment. In this paper, we explore the possibility of finding an alternative source of comments to guarantee the availability of diverse comments, especially those from silent users. Specifically, we propose to adopt large language models (LLMs) as a user simulator and comment generator, and design GenFEND, a generated feedback-enhanced detection framework, which generates comments by prompting LLMs with diverse user profiles and aggregating generated comments from multiple subpopulation groups. Experiments demonstrate the effectiveness of GenFEND and further analysis shows that the generated comments cover more diverse users and could even be more effective than actual comments.
Aalto University(阿尔托大学);National Institute of Information and Communications Technology(信息通信研究机构);Waseda University(早稻田大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心)
自动生成的虚假餐馆评论对在线评论系统构成了威胁。最近的研究表明,用户很难发现隐藏在真实餐厅评论中的机器生成的虚假评论。这项工作中使用的方法(char-LSTM)有一个缺点:它很难保持在上下文中,即当它为特定目标实体生成评论时,所产生的评论可能包含与目标无关的短语,从而增加了其可检测性。在这项工作中,我们提出并评估了一种基于神经机器翻译(NMT)的更复杂的技术,我们可以使用该技术生成保持主题的评论。我们使用母语为英语的人在Amazon Mechanical Turk上测试了我们的技术的多个变体。我们证明,由最佳变体生成的评论具有几乎最佳的不可检测性(类平均F分数为47%)。我们对持怀疑态度的用户进行了一项用户研究,结果表明,与最新技术水平相比,我们的方法更频繁地逃避检测(平均逃避3.2/4 vs 1.5/4),具有统计学显著性,α = 1%(第4.3节)。我们开发了非常有效的检测工具,并在分类中达到了97%的平均F分数。虽然虚假评论在愚弄人们方面非常有效,但有效的自动检测仍然是可行的。
Multimodal Hate Speech Detection from Bengali Memes and Texts
Fraunhofer FIT(弗劳恩霍夫应用信息技术研究所);RWTH Aachen University(亚琛工业大学);Noakhali Science and Technology University(诺阿卡利科技大学);University of Siegen(锡根大学);University of Galway(戈尔韦大学)