arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.08209q-bio.NCcs.LG
收藏

建模视觉幻觉:一种生成对抗网络框架

Modeling Visual Hallucination: A Generative Adversarial Network Framework

Department of Electrical and Computer Engineering, Isfahan University of Technology(伊斯法罕技术大学电气与计算机工程系);Department of Electrical and Computer Engineering, University of Arizona(亚利桑那大学电气工程系)

Masoumeh Zareh, Mohammad Hossein Manshaei, Sayed Jalal Zahabi, Marwan Krunz

AI总结:

本研究提出基于生成对抗网络的Hallu-GAN及扩展模型Hallu-GAN+,模拟视觉系统与额叶的对抗交互,解释视觉幻觉产生机制,并通过模拟和EEG数据验证其有效性。

摘要:

视觉幻觉指的是感知到并不存在的可识别事物。这些现象通常与一系列神经/精神疾病相关。尽管研究持续进行,视觉系统从真实世界环境中产生幻觉的机制仍未被充分理解。负责感知的大脑不同区域之间的异常相互作用被认为有助于视觉幻觉的发生。在本研究中,我们提出并扩展了一个基于生成神经网络的框架,以应对视觉系统内的挑战,旨在创建受视觉幻觉神经生物学机制启发的目标驱动模型。我们关注视觉系统与额叶区域之间的对抗性相互作用,提出Hallu-GAN模型来表明这些相互作用如何导致视觉幻觉。Hallu-GAN模型的架构基于生成对抗网络。我们的模拟结果表明,腹侧通路的干扰可导致视觉幻觉。为了进一步分析其他大脑区域对视觉系统的影响,我们通过添加个体的脑电图(EEG)数据来扩展Hallu-GAN模型。这个扩展模型称为Hallu-GAN+,能够检查幻觉和非幻觉状态。通过使用一位患有Charles Bonnet综合征的个体的EEG数据训练Hallu-GAN+模型,我们展示了其在分析经历幻觉者行为方面的实用性。我们的模拟结果证实了所提模型在模拟健康和幻觉状态下视觉系统方面的能力。

英文摘要:

Visual hallucination refers to the perception of recognizable things that are not present. These phenomena are commonly linked to a range of neurological/psychiatric disorders. Despite ongoing research, the mechanisms through which the visual system generates hallucinations from real-world environments are still not well understood. Abnormal interactions between different regions of the brain responsible for perception are known to contribute to the occurrence of visual hallucinations. In this study, we propose and extend a generative neural network-based framework to address challenges within the visual system, aiming to create goal-driven models inspired by neurobiological mechanisms of visual hallucinations. We focus on the adversarial interactions between the visual system and the frontal lobe regions, proposing the Hallu-GAN model to suggest how these interactions can give rise to visual hallucinations. The architecture of the Hallu-GAN model is based on generative adversarial networks. Our simulation results indicate that disturbances in the ventral stream can lead to visual hallucinations. To further analyze the impact of other brain regions on the visual system, we extend the Hallu-GAN model by adding EEG data from individuals. This extended model, referred to as Hallu-GAN+, enables the examination of both hallucinating and non-hallucinating states. By training the Hallu-GAN+ model with EEG data from an individual with Charles Bonnet syndrome, we demonstrated its utility in analyzing the behavior of those experiencing hallucinations. Our simulation results confirmed the capability of the proposed model in resembling the visual system in both healthy and hallucinating states.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑