arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.02531cs.CV
收藏

SchiNet:从面部行为分析自动估计精神分裂症的症状

SchiNet: Automatic Estimation of Symptoms of Schizophrenia from Facial Behaviour Analysis

Queen Mary University of London(伦敦玛丽女王大学);MindVisionLabs LTD(MindVisionLabs有限公司)

Mina Bishay, Petar Palasek, Stefan Priebe, Ioannis Patras

摘要:

精神分裂症患者经常表现出情感和言语表达的障碍,这些障碍可以在他们的面部行为中观察到。以精神分裂症的症状为目的的面部表情的自动分析近年来受到关注。然而,通常用于训练和评估所开发方法的数据集仅包含少量患者(4-34),并且在受试者执行受控任务(如听生活小插曲或回答情感问题)时记录。在本文中,我们使用专业患者访谈的视频,其中症状以标准化的方式进行评估,因为它们应该/可以在实践中进行评估,并且在患者家中或精神卫生服务中记录在现实条件下(即不同的照明水平和摄像机视角)。我们自动分析了91名门诊患者的面部行为-这几乎是其他研究中患者数量的3倍-并提出了SchiNet,这是一种新型的神经网络架构,可以在两种不同的评估访谈中估计与表情相关的症状。我们评估建议SchiNet独立于患者的精神分裂症症状的预测。实验结果表明,一些自动检测到的面部表情显着相关的精神分裂症的症状,并提出的网络估计症状的严重程度提供了有前途的结果。

英文摘要:

Patients with schizophrenia often display impairments in the expression of emotion and speech and those are observed in their facial behaviour. Automatic analysis of patients' facial expressions that is aimed at estimating symptoms of schizophrenia has received attention recently. However, the datasets that are typically used for training and evaluating the developed methods, contain only a small number of patients (4-34) and are recorded while the subjects were performing controlled tasks such as listening to life vignettes, or answering emotional questions. In this paper, we use videos of professional-patient interviews, in which symptoms were assessed in a standardised way as they should/may be assessed in practice, and which were recorded in realistic conditions (i.e. varying illumination levels and camera viewpoints) at the patients' homes or at mental health services. We automatically analyse the facial behaviour of 91 out-patients - this is almost 3 times the number of patients in other studies - and propose SchiNet, a novel neural network architecture that estimates expression-related symptoms in two different assessment interviews. We evaluate the proposed SchiNet for patient-independent prediction of symptoms of schizophrenia. Experimental results show that some automatically detected facial expressions are significantly correlated to symptoms of schizophrenia, and that the proposed network for estimating symptom severity delivers promising results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑