arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.06005cs.CV
收藏

推进自动化欺骗检测:一种面向特征提取与分析的多模态方法

Advancing Automated Deception Detection: A Multimodal Approach to Feature Extraction and Analysis

OCTOBER UNIVERSITY FOR MODERN SCIENCES ARTS - MSA UNIVERSITY(十月现代科学艺术大学 - MSA大学)

Mohamed Bahaa, Mena Hany, Ehab E. Zakaria

AI总结:

针对视频内容增长下的精准欺骗检测需求,本研究通过提取融合视觉、音频、文本多模态特征,结合多种机器学习模型构建了鲁棒检测框架,准确率达99%,验证了多模态融合的性能优势,为自动化欺骗检测发展提供支撑。

摘要:

随着视频内容呈指数级增长,在以人为中心的视频分析中实现精准欺骗检测的需求已变得极为迫切。本研究聚焦于多种特征的提取与融合,以提升欺骗检测模型的准确率。通过系统地从视觉、音频和文本数据中提取特征,并对不同的特征组合开展实验,我们构建了一个鲁棒的模型,取得了高达99%的准确率。我们的方法凸显了特征工程在欺骗检测中的重要性,提供了一个清晰且可解释的框架。我们采用单模态和多模态两种方式,训练了多种机器学习模型,包括LSTM(长短期记忆网络)、BiLSTM(双向长短期记忆网络)和预训练CNN(卷积神经网络)。结果表明,与单模态训练相比,融合多种模态可显著提升检测性能。本研究彰显了策略性特征提取与融合在构建视频分析领域可靠且透明的自动化欺骗检测系统中的潜力,为未来研究中更先进、更精准的检测方法奠定了基础。

英文摘要:

With the exponential increase in video content, the need for accurate deception detection in human-centric video analysis has become paramount. This research focuses on the extraction and combination of various features to enhance the accuracy of deception detection models. By systematically extracting features from visual, audio, and text data, and experimenting with different combinations, we developed a robust model that achieved an impressive 99% accuracy. Our methodology emphasizes the significance of feature engineering in deception detection, providing a clear and interpretable framework. We trained various machine learning models, including LSTM, BiLSTM, and pre-trained CNNs, using both single and multi-modal approaches. The results demonstrated that combining multiple modalities significantly enhances detection performance compared to single modality training. This study highlights the potential of strategic feature extraction and combination in developing reliable and transparent automated deception detection systems in video analysis, paving the way for more advanced and accurate detection methodologies in future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑