arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.02469cs.CVcs.AI

Multimodal Gait Recognition for Neurodegenerative Diseases

Qingdao University(青岛大学);Ocean University of China(中国海洋大学);Queen Mary University of London(伦敦玛丽女王大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Hohai University(河海大学);University of Leicester(莱斯特大学)

Aite Zhao, Jianbo Li, Junyu Dong, Lin Qi, Qianni Zhang, Ning Li, Xin Wang, Huiyu Zhou

英文摘要:

In recent years, single modality based gait recognition has been extensively explored in the analysis of medical images or other sensory data, and it is recognised that each of the established approaches has different strengths and weaknesses. As an important motor symptom, gait disturbance is usually used for diagnosis and evaluation of diseases; moreover, the use of multi-modality analysis of the patient's walking pattern compensates for the one-sidedness of single modality gait recognition methods that only learn gait changes in a single measurement dimension. The fusion of multiple measurement resources has demonstrated promising performance in the identification of gait patterns associated with individual diseases. In this paper, as a useful tool, we propose a novel hybrid model to learn the gait differences between three neurodegenerative diseases, between patients with different severity levels of Parkinson's disease and between healthy individuals and patients, by fusing and aggregating data from multiple sensors. A spatial feature extractor (SFE) is applied to generating representative features of images or signals. In order to capture temporal information from the two modality data, a new correlative memory neural network (CorrMNN) architecture is designed for extracting temporal features. Afterwards, we embed a multi-switch discriminator to associate the observations with individual state estimations. Compared with several state-of-the-art techniques, our proposed framework shows more accurate classification results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑