A Deep Learning Approach for Multimodal Deception Detection
A*STAR Artificial Intelligence Initiative (A*AI), Institute of High Performance Computing(新加坡科技研究局人工智能计划(A*AI),高性能计算研究所);Centro de Investigacin en Computacin, IPN(墨西哥国立理工学院计算研究中心);Temasek Laboratories, Nanyang Technological University(南洋理工大学淡马锡实验室);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院)
Gangeshwar Krishnamurthy, Navonil Majumder, Soujanya Poria, Erik Cambria
Automatic deception detection is an important task that has gained momentum in computational linguistics due to its potential applications. In this paper, we propose a simple yet tough to beat multi-modal neural model for deception detection. By combining features from different modalities such as video, audio, and text along with Micro-Expression features, we show that detecting deception in real life videos can be more accurate. Experimental results on a dataset of real-life deception videos show that our model outperforms existing techniques for deception detection with an accuracy of 96.14% and ROC-AUC of 0.9799.
MuDD: A Multimodal Deception Detection Dataset and GSR-Guided Progressive Distillation for Non-Contact Deception Detection
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院)
Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networks
University of Michigan(密歇根大学);Columbia University(哥伦比亚大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Saarland University of Applied Science(萨尔应用科学大学)
Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge
Bielefeld University(比勒费尔德大学);University of Bonn(波恩大学)
互联网上的模因通常是无害的,有时很有趣。然而,通过使用某些类型的图像,文本或两者的组合,看似无害的模因变成了一种多模态的仇恨言论-仇恨模因。Hateful Memes Challenge是首个专注于检测多模态模因中的仇恨言论的竞赛,它提出了一个包含10,000多个多模态内容新示例的新数据集。我们利用VisualBERT --这意味着是视觉和语言的BERT--它是在图像和字幕上进行多模态训练的,并应用了包围学习。我们的方法在挑战测试集上达到了0.811 AUROC,准确率为0.765,并在仇恨模因挑战的3,173名参与者中排名第三。
Dynamic Emotion and Personality Profiling for Multimodal Deception Detection
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University(航天信息安全部门与可信计算教育部重点实验室,网络安全科学与工程学院,武汉大学)
A review of deep learning-based information fusion techniques for multimodal medical image classification
Inserm(法国国家健康与医学研究院);University of Western Brittany(西布列塔尼大学);IMT Atlantique(大西洋电信学院);Sorbonne University(索邦大学);Lariboisière Hospital(拉里布瓦西耶尔医院);AP-HP(巴黎公共医疗集团);Paris Cité University(巴黎城市大学);CHRU Brest(布雷斯特大学中心医院);LaTIM UMR 1101(LaTIM联合研究单位1101)
Can Deception Detection Go Deeper? Dataset, Evaluation, and Benchmark for Deception Reasoning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Shanghai Jiao Tong University(上海交通大学);Inner Mongolia University(内蒙古大学);Tsinghua University(清华大学);Peking University(北京大学)
Explainable Verbal Deception Detection using Transformers
National Technical University of Athens(雅典国立技术大学);GESIS – Leibniz Institute for the Social Science(莱布尼茨社会科学研究所);University College London(伦敦大学学院);Tilburg University(蒂尔堡大学)
QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents
McGill University(麦吉尔大学);Mila - Quebec AI Institute(魁北克人工智能研究所);University of Cambridge(剑桥大学);MBZUAI - Mohamed bin Zayed University of Artificial Intelligence(MBZUAI - 摩苏尔·本·扎耶德人工智能大学);University of Toronto(多伦多大学);Salesforce
SEPSIS: I Can Catch Your Lies -- A New Paradigm for Deception Detection
Massachusetts Institute of Technology(麻省理工学院);IIT Gandhinagar, India(印度加尔各答理工学院);Politecnico di Milano, Italy(意大利米兰理工大学);DTU, India(印度技术大学);Stanford University, USA(斯坦福大学);Amazon AI, USA(亚马逊人工智能);University of South Carolina, USA(南卡罗来纳大学)
Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generation
National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);University of Edinburgh(爱丁堡大学);Beijing Institute of Technology(北京理工大学)
人口贩运是一种全球性流行病,影响到全球数百万人。人口贩运的主要形式-性贩运-显著增加,主要是因为伴游网站大量存在,人口贩运者可以在这些网站上公开刊登任意伴游广告。在本文中,我们在自动检测涉嫌涉及人口贩运的广告方面迈出了重要的一步。我们提出了一个名为Trafficking-10 k的新数据集,其中包含超过10,000个针对此任务的广告注释。该数据集包含每个广告的两个信息源:文本和图像。为了准确检测贩运广告,我们设计并训练了一个名为Human Trafficking Deep Network(HTDN)的深度多模态模型。