arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.18352cs.CVcs.AI
收藏

基于深度学习的面部表情数据事后与流形解释分析

Post-hoc and manifold explanations analysis of facial expression data based on deep learning

Nankai University(南开大学)

Yang Xiao

AI总结:

本文利用 VGG16 模型研究神经网络对面部表情数据的处理与存储,从非欧几里得空间建立流形可视化解释,揭示深度学习在理解人类情绪和认知过程中的潜力,为增强 AI 可解释性提供新见解。

摘要:

人类复杂的信息处理系统产生大量客观和主观评价,使得探索人类认知产物具有极大的前沿理论价值。近年来,受生物大脑机制启发的深度学习技术在心理或认知科学研究中取得显著进展,特别是在面部数据的记忆和识别方面。本文通过实验研究探讨了神经网络如何处理和存储面部表情数据,并将这些数据与人类产生的一系列心理属性相关联。研究人员利用深度学习模型 VGG16,证明神经网络能够学习并重现面部数据的关键特征,从而存储图像记忆。此外,实验结果揭示了深度学习模型在理解人类情绪和认知过程方面的潜力,并从非欧几里得空间视角建立了认知产物或心理属性的流形可视化解释,为增强 AI 的可解释性提供了新见解。本研究不仅推进了 AI 技术在心理学领域的应用,也为理解 AI 的信息处理提供了新的心理学理论。代码获取地址:https://github.com/NKUShaw/Psychoinformatics。

英文摘要:

The complex information processing system of humans generates a lot of objective and subjective evaluations, making the exploration of human cognitive products of great cutting-edge theoretical value. In recent years, deep learning technologies, which are inspired by biological brain mechanisms, have made significant strides in the application of psychological or cognitive scientific research, particularly in the memorization and recognition of facial data. This paper investigates through experimental research how neural networks process and store facial expression data and associate these data with a range of psychological attributes produced by humans. Researchers utilized deep learning model VGG16, demonstrating that neural networks can learn and reproduce key features of facial data, thereby storing image memories. Moreover, the experimental results reveal the potential of deep learning models in understanding human emotions and cognitive processes and establish a manifold visualization interpretation of cognitive products or psychological attributes from a non-Euclidean space perspective, offering new insights into enhancing the explainability of AI. This study not only advances the application of AI technology in the field of psychology but also provides a new psychological theoretical understanding the information processing of the AI. The code is available in here: https://github.com/NKUShaw/Psychoinformatics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑