Parkinson's disease (PD) is a progressive degenerative disorder of the central nervous system characterized by motor and non-motor symptoms. As the disease progresses, patients alternate periods in which motor symptoms are mitigated due to medication intake (ON state) and periods with motor complications (OFF state). The time that patients spend in the OFF condition is currently the main parameter employed to assess pharmacological interventions and to evaluate the efficacy of different active principles. In this work, we present a system that combines automatic speech processing and deep learning techniques to classify the medication state of PD patients by leveraging personal speech-based bio-markers. We devise a speaker-dependent approach and investigate the relevance of different acoustic-prosodic feature sets. Results show an accuracy of 90.54% in a test task with mixed speech and an accuracy of 95.27% in a semi-spontaneous speech task. Overall, the experimental assessment shows the potentials of this approach towards the development of reliable, remote daily monitoring and scheduling of medication intake of PD patients.
On the Relevance of Clinical Assessment Tasks for the Automatic Detection of Parkinson's Disease Medication State from Speech
Universitat Politècnica de València（瓦伦西亚理工大学）；Universidade de Lisboa（里斯本大学）；Faculdade de Medicina, Universidade de Lisboa（里斯本大学医学院）；PRHLT INESC-ID；Instituto Superior Técnico（技术高等学院）；Laboratory of Clinical Pharmacology and Therapeutics（临床药理与治疗实验室）；CNS - Campus Neurológico Alcoitão（神经学中心-阿尔科伊托昂校园）；Health School of Sciences（健康科学学院）
Speech disorders often occur at the early stage of Parkinson's disease (PD). The speech impairments could be indicators of the disorder for early diagnosis, while motor symptoms are not obvious. In this study, we constructed a new speech corpus of Mandarin Chinese and addressed classification of patients with PD. We implemented classical machine learning methods with ranking algorithms for feature selection, convolutional and recurrent deep networks, and an end to end system. Our classification accuracy significantly surpassed state-of-the-art studies. The result suggests that free talk has st…
Idiap Research Institute（伊迪亚普研究所）；École Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）
Recently proposed automatic pathological speech classification techniques use unsupervised auto-encoders to obtain a high-level abstract representation of speech. Since these representations are learned based on reconstructing the input, there is no guarantee that they are robust to pathology-unrelated cues such as speaker identity information. Further, these representations are not necessarily discriminative for pathology detection. In this paper, we exploit supervised auto-encoders to extract robust and discriminative speech representations for Parkinson's disease classification. To reduce t…
Assessing Progress of Parkinson s Disease Using Acoustic Analysis of Phonation
Brno University of Technology（布尔诺理工大学）；St. Anne’s University Hospital（圣安妮大学医院）；Central European Institute of Technology（中欧技术研究所）；Masaryk University（马萨里克大学）；Faculty Hospital（大学医院）；Escola Universitaria Politecnica de Mataro（马塔罗大学理工学院）；University of the Basque Country UPV/EHU（巴斯克大学（UPV/EHU））；Institute for Technological Development and Innovation in Communications (IDeTIC)（通信技术发展与创新研究所（IDeTIC））；University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）
Parkinson's disease is a neurodegenerative disorder characterized by the presence of different motor impairments. Information from speech, handwriting, and gait signals have been considered to evaluate the neurological state of the patients. On the other hand, user models based on Gaussian mixture models - universal background models (GMM-UBM) and i-vectors are considered the state-of-the-art in biometric applications like speaker verification because they are able to model specific speaker traits. This study introduces the use of GMM-UBM and i-vectors to evaluate the neurological state of Par…
Evaluating Parkinson's Disease Detection in Anonymized Speech: A Performance and Acoustic Analysis
German Research Center for Artificial Intelligence（德国人工智能研究中心）；INESC-ID；Technical University of Berlin（柏林技术大学）；Instituto Superior Técnico, University of Lisbon（里斯本大学理工学院）
Carnegie Mellon University Africa（卡内基梅隆大学非洲分校）；Carnegie Mellon University（卡内基梅隆大学）；INSOFE（国际工程与科学教育研究所）
One of the symptoms observed in the early stages of Parkinson's Disease (PD) is speech impairment. Speech disorders can be used to detect this disease before it degenerates. This work analyzes speech features and machine learning approaches to predict PD. Acoustic features such as shimmer and jitter variants, and Mel Frequency Cepstral Coefficients (MFCC) are extracted from speech signals. We use two datasets in this work: the MDVR-KCL and the Italian Parkinson's Voice and Speech database. To separate PD and non-PD speech signals, seven classification models were implemented: K-Nearest Neighbo…
From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Disease
McGill University（麦吉尔大学）；Centre for Research on Brain, Language, and Music（大脑、语言和音乐研究中心）；Mila - Quebec AI Institute（魁北克人工智能研究所）；Douglas Research Centre（道格拉斯研究中心）；Concordia University（Concordia大学）
Parkinson's Disease Detection through Vocal Biomarkers and Advanced Machine Learning Algorithms
New Jersey City University（新泽西城市大学）；University of South Dakota（南达科他大学）；Monroe College（门罗学院）；University of Texas at Dallas（德州大学达拉斯分校）；International American University（国际美国大学）；Gannon University（甘农大学）；Saint Francis College（圣弗朗西斯学院）
People with Parkinson's disease must be regularly monitored by their physician to observe how the disease is progressing and potentially adjust treatment plans to mitigate the symptoms. Monitoring the progression of the disease through a voice recording captured by the patient at their own home can make the process faster and less stressful. Using a dataset of voice recordings of 42 people with early-stage Parkinson's disease over a time span of 6 months, we applied multiple machine learning techniques to find a correlation between the voice recording and the patient's motor UPDRS score. We ap…
Brno University of Technology（布尔诺理工大学）；St. Anne’s University Hospital（圣安妮大学医院）；Masaryk University（马萨里克大学）；Escola Universitaria Politecnica de Mataro（马塔罗理工学院）；University of the Basque Country UPV/EHU（巴斯克大学）
Up to 90% of patients with Parkinson's disease (PD) suffer from hypokinetic dysathria (HD) which is also manifested in the field of phonation. Clinical signs of HD like monoloudness, monopitch or hoarse voice are usually quantified by conventional clinical interpretable features (jitter, shimmer, harmonic-to-noise ratio, etc.). This paper provides large and robust insight into perceptual analysis of 5 Czech vowels of 84 PD patients and proves that despite the clinical inexplicability the perceptual features outperform the conventional ones, especially in terms of discrimination power (classifi…
Semnan University（塞姆南大学）；Amirkabir University of Technology (Tehran Polytechnic)（阿米尔卡比尔理工大学（德黑兰理工大学））
Background and Objective: Parkinson's disease (PD) is the second most common progressive neurological condition after Alzheimer's, characterized by motor and non-motor symptoms. Developing a method to diagnose the condition in its beginning phases is essential because of the significant number of individuals afflicting with this illness. PD is typically identified using motor symptoms or other Neuroimaging techniques, such as DATSCAN and SPECT. These methods are expensive, time-consuming, and unavailable to the general public; furthermore, they are not very accurate. These constraints encourag…
Universidad de Antioquia UdeA（安蒂奥基亚大学）；Czech Technical University in Prague（布拉格捷克技术大学）
Parkinson's disease patients develop different speech impairments that affect their communication capabilities. The automatic assessment of the speech of the patients allows the development of computer aided tools to support the diagnosis and the evaluation of the disease severity. This paper introduces a methodology to classify Parkinson's disease from speech in three different languages: Spanish, German, and Czech. The proposed approach considers convolutional neural networks trained with time frequency representations and a transfer learning strategy among the three languages. The transfer …
Zero-Shot Parkinson's Disease Detection from Speech: Comparing Large Audio and Language Models
School of Computing, Mathematics and Engineering, Charles Sturt University（计算机科学与工程学院，查尔斯·斯图尔特大学）；Department of Computer Science, Rensselaer Polytechnic Institute（计算机科学系，伦塞拉尔理工学院）
A Benchmark for Early-stage Parkinson's Disease Detection from Speech
Centre for Language Studies, Radboud University, Nijmegen, the Netherlands（语言研究所以及拉德堡德大学，尼姆egen，荷兰）；Center of Expertise for Parkinson and Movement Disorders, Radboud University Medical Center, Nijmegen, the Netherlands（帕金森及运动障碍专家研究所，拉德堡德大学医学中心，尼姆egen，荷兰）
University of Rochester（罗切斯特大学）；BUET（孟加拉国工程技术大学）；University of Rochester Medical Center（罗切斯特大学医学中心）；University of Birmingham（伯明翰大学）；MIT（麻省理工学院）
In this paper, we envision a web-based framework that can help anyone, anywhere around the world record a short speech task, and analyze the recorded data to screen for Parkinson's disease (PD). We collected data from 726 unique participants (262 PD, 38% female; 464 non-PD, 65% female; average age: 61) -- from all over the US and beyond. A small portion of the data was collected in a lab setting to compare quality. The participants were instructed to utter a popular pangram containing all the letters in the English alphabet "the quick brown fox jumps over the lazy dog..". We extracted both sta…
